00000001:02000400:1.0F:1788863374.985619:0:3291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788863394.694412:0:3518:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788863396.377166:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 478 MB/s 00000001:01000000:0.0:1788863396.627270:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 447 MB/s 00000001:01000000:2.0:1788863396.877341:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4791 MB/s 00000020:02000000:2.0:1788863397.583971:0:3609:0:(class_obd.c:842:obdclass_init()) Lustre: Build Version: 2.17.58_39_g86006df 00000400:02000000:1.0:1788863398.401258:0:3624:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.135@tcp [8/256/0/180] 00008000:02000000:3.0F:1788863402.003963:0:3774:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788863476.755700:0:5763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788863494.115890:0:6513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788863494.115897:0:6513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788863494.115899:0:6513:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788863494.116023:0:6513:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004e94f401 00000080:02000400:2.0:1788863494.116036:0:6513:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788863494.145697:0:6513:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788863494.145711:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788863494.146849:0:6513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000621aa940) 00000020:00000080:0.0:1788863494.146882:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788863494.219856:0:6513:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788863494.220161:0:6513:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788863494.262283:0:6513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788863494.263310:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788863494.263321:0:6513:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788863494.263339:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6881b 00000020:01000004:2.0:1788863494.263349:0:6513:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788863494.263355:0:6513:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788863494.263361:0:6513:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004e94f401 from MGS 00000020:01000004:2.0:1788863494.263366:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788863494.263392:0:6513:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000066606df9) 00000020:00000080:2.0:1788863494.263407:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788863494.263539:0:6513:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e94f401 from MGS, refs=2 00080000:01000000:2.0:1788863494.263545:0:6513:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788863494.263551:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b68829 00000100:00100000:2.0:1788863494.268138:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788863494.268362:0:6513:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788863494.268369:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788863494.273556:0:6513:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788863494.273580:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788863494.277401:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863494.277592:0:6513:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788863494.277598:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788863494.293833:0:6513:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788863494.293851:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788863494.302751:0:6513:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788863494.302768:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788863494.307969:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863494.307976:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863494.307978:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863494.309123:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863494.309128:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863494.309130:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863494.309905:0:6513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788863494.318127:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788863494.562051:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3408 MB/s 00000001:01000000:1.0:1788863494.811513:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2475 MB/s 00000001:01000000:2.0:1788863495.068980:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 225 MB/s 00000001:01000000:0.0:1788863495.320526:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 452 MB/s 00010000:00010000:1.0:1788863495.344859:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788863495.368059:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788863495.460387:0:6513:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788863495.463175:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788863495.463300:0:6513:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788863495.463349:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788863495.463540:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788863495.463562:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788863495.466377:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863495.466588:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788863495.466595:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788863495.471241:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788863495.471256:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788863495.471889:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788863495.471897:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788863495.501471:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788863495.501501:0:6513:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.135@tcp' 00000020:01000004:1.0:1788863495.501502:0:6513:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788863495.501545:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.135@tcp (typ=mgc) 00000020:00000080:1.0:1788863495.501574:0:6513:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.135@tcp (0000000037537b0f) 00000020:00000080:1.0:1788863495.501590:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788863495.501725:0:6513:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006763208b@MGC192.168.204.135@tcp: add connection 192.168.204.135@tcp at head 00000100:00080000:0.0:1788863495.502246:0:6533:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1788863495.504274:0:6513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.135@tcp-0 is initialized 00000040:01000000:1.0:1788863495.504288:0:6513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788863495.518416:0:6534:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788863495.518478:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.135@tcp (uuid 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc) 00000020:00000080:0.0:1788863495.518504:0:6513:0:(genops.c:1384:class_connect()) connect: client 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc, cookie 0xf569beb9d4b68837 00000100:00080000:0.0:1788863495.518517:0:6513:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788863495.518526:0:6513:0:(import.c:666:import_select_connection()) MGC192.168.204.135@tcp: import 000000006763208b using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863495.518578:0:6513:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c7df24c2 x1875759226421376/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863495.518598:0:6513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS 00000020:01000004:0.0:1788863495.518614:0:6513:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788863495.518619:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788863495.518633:0:6513:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000080a7f738) 00000020:00000080:0.0:1788863495.518645:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788863495.537088:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7df24c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3639:1875759226421376:0@lo:250: 00000100:00100000:3.0:1788863495.537643:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863495.537747:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226421376 00000100:00100000:3.0:1788863495.537756:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226421376 00000100:00100000:3.0:1788863495.537794:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863495.537800:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f74ee8fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1875759226421376:12345-0@lo:250: 00010000:00080000:3.0:1788863495.538036:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1788863495.538233:0:6529:0:(genops.c:1384:class_connect()) connect: client 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc, cookie 0xf569beb9d4b68845 00000100:00080000:3.0:1788863495.538372:0:6529:0:(import.c:65:import_set_state_nolock()) 00000000e7f0d0af : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863495.538427:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f74ee8fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:3639:x1875759226421376:12345-0@lo:250: Request processed in 627us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863495.538436:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863495.538495:0:3639:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788863495.538504:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:3.0:1788863495.538511:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788863495.538516:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788863495.538519:0:3639:0:(import.c:65:import_set_state_nolock()) 000000006763208b MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788863495.538521:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788863495.538533:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788863495.538539:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7df24c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3639:1875759226421376:0@lo:250: 00000100:00100000:0.0:1788863495.558029:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863495.558381:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788863495.558389:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788863495.559902:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788863495.559913:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788863495.560885:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788863495.560894:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788863495.562026:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863495.563050:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788863495.563057:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788863495.563784:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788863495.563791:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788863495.688907:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863495.689522:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788863495.689530:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788863495.692359:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788863495.692371:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788863495.698109:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863495.698338:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788863495.698345:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788863495.699591:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788863495.699601:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788863495.701727:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863495.701910:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788863495.701916:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788863495.702621:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788863495.702629:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788863495.703777:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863495.703981:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788863495.703988:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788863495.704926:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788863495.704934:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788863495.752575:0:6513:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863495.752833:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788863495.752840:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788863495.755024:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788863495.755039:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788863495.761441:0:6513:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788863495.761468:0:6513:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788863495.765027:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788863495.765055:0:6513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788863495.765061:0:6513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788863495.765196:0:6513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788863495.765230:0:6513:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788863495.765235:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788863495.765236:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788863495.765238:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863495.765239:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863495.765240:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863495.765241:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863495.765243:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863495.765244:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788863495.765246:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863495.765247:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863495.765248:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863495.765250:0:6513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788863495.765262:0:6513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788863495.765265:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863495.765266:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788863495.765266:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863495.765268:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863495.765268:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863495.765269:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863495.765270:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863495.765271:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788863495.765272:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863495.765273:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863495.765274:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863495.765275:0:6513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788863495.765316:0:6513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788863495.765336:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003de5b1c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421504:0@lo:253: 00000100:00100000:1.0:1788863495.765426:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863495.765476:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d21e1c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788863495.767017:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226421504 00000100:00100000:0.0:1788863495.767030:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226421504 00000100:00100000:0.0:1788863495.767130:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863495.767143:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c6bc8bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:6513:x1875759226421504:12345-0@lo:253: 20000000:01000000:0.0:1788863495.767205:0:6532:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788863495.767207:0:6532:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788863495.768433:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788863495.769317:0:6532:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788863495.769594:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863495.772343:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788863495.778439:0:6532:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788863495.778448:0:6532:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788863495.778454:0:6532:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788863495.778458:0:6532:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788863495.778472:0:6532:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788863495.778711:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863495.778886:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788863495.778903:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788863495.778919:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788863495.778933:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788863495.778947:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788863495.779948:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788863495.779979:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788863495.780001:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788863495.780007:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788863495.780021:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788863495.780026:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788863495.780036:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788863495.780049:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788863495.780210:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788863495.780216:0:6532:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788863495.780224:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863495.782427:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788863495.782454:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788863495.782482:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788863495.782498:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788863495.782524:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788863495.782537:0:6532:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788863495.782577:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788863495.782584:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788863495.782597:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788863495.782612:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788863495.782628:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788863495.782636:0:6532:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788863495.782670:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788863495.782678:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788863495.782691:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788863495.782705:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788863495.794404:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788863495.794479:0:6532:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788863495.794486:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788863495.798166:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788863495.798583:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788863495.798697:0:6532:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.135@tcp for mdt 20000000:01000000:1.0:1788863495.798700:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:1.0:1788863495.798729:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788863495.798738:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788863495.798753:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788863495.798759:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:1.0:1788863495.798771:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788863495.798779:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788863495.798791:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788863495.798805:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788863495.798836:0:6532:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788863495.798840:0:6532:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788863495.798844:0:6532:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788863495.798886:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788863495.798889:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788863495.799681:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788863495.799889:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788863495.799914:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788863495.799929:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788863495.799941:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788863495.799942:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788863495.800628:0:6556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788863495.800856:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788863495.800878:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788863495.800898:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788863495.800909:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788863495.800911:0:6532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788863495.800915:0:6532:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788863495.800918:0:6532:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788863495.800923:0:6532:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788863495.800928:0:6532:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788863495.810390:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788863495.810601:0:6532:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788863495.824845:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788863495.824887:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788863495.824904:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788863495.824925:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788863495.824949:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.824978:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.824989:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.824994:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.825000:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.825007:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.825013:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008353d384 already unused, calling callback (0000000050850020) 00010000:00010000:2.0:1788863495.825018:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.825025:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.825057:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.825065:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.825071:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008353d384/0xf569beb9d4b6884c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863495.825131:0:6532:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788863495.847889:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c6bc8bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:6513:x1875759226421504:12345-0@lo:253: Request processed in 80739us (82455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863495.847906:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863495.848195:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003de5b1c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421504:0@lo:253: 10000000:01000000:1.0:1788863495.848211:0:6513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788863495.848215:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863495.848217:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788863495.848230:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863495.848231:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788863495.848233:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863495.848235:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863495.848236:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863495.848238:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788863495.848239:0:6513:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788863495.848241:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863495.848242:0:6513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788863495.848270:0:6513:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004e94f401 from lustre-MDT0000 10000000:01000000:1.0:1788863495.848298:0:6513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788863495.848300:0:6513:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788863495.848304:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89e671354d40 10000000:01000000:1.0:1788863495.848307:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863495.848315:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89e671354d40 from 1 10000000:01000000:1.0:1788863495.848318:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788863495.848354:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.848364:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.848374:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863495.848391:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003de5b1c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421632:0@lo:101: 00000100:00100000:1.0:1788863495.848425:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863495.848481:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8c7755d going to sleep for 11 seconds 00000100:00100000:3.0:1788863495.848536:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226421632 00000100:00100000:3.0:1788863495.848551:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226421632 00000100:00100000:3.0:1788863495.848591:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863495.848598:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000056e34344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:6513:x1875759226421632:12345-0@lo:101: 00010000:00010000:3.0:1788863495.848611:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863495.848623:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68853 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863495.848663:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 6 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863495.848672:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 6 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863495.848682:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001bbee2c, rc 0) 00000100:00100000:3.0:1788863495.848715:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000056e34344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:6513:x1875759226421632:12345-0@lo:101: Request processed in 117us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863495.848721:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863495.849246:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003de5b1c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421632:0@lo:101: 00010000:00010000:2.0:1788863495.849272:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863495.849281:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863495.849362:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e539b810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421760:0@lo:501: 00000100:00100000:2.0:1788863495.849399:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863495.849429:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089795faf going to sleep for 11 seconds 00000100:00100000:3.0:1788863495.849532:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226421760 00000100:00100000:3.0:1788863495.849537:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226421760 00000100:00100000:3.0:1788863495.849580:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863495.849585:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009b056e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:6513:x1875759226421760:12345-0@lo:501: 00000100:00100000:3.0:1788863495.849683:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009b056e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:6513:x1875759226421760:12345-0@lo:501: Request processed in 98us (284us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863495.849690:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863495.849821:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e539b810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421760:0@lo:501: 10000000:01000000:1.0:1788863495.849863:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788863495.849879:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.849899:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863495.849906:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e64a89a800 10000000:01000000:1.0:1788863495.849910:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788863495.849913:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e64a89a800 10000000:01000000:1.0:1788863495.849916:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788863495.849919:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89e64a89a800 from 1 10000000:01000000:1.0:1788863495.849921:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788863495.849940:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000008417e14/0xf569beb9d4b68861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.849946:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000008417e14/0xf569beb9d4b68861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.849952:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000008417e14/0xf569beb9d4b68861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863495.849964:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421888:0@lo:101: 00000100:00100000:1.0:1788863495.849989:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863495.850004:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000276d0128 going to sleep for 11 seconds 00000100:00100000:1.0:1788863495.850020:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226421888 00000100:00100000:1.0:1788863495.850024:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226421888 00000100:00100000:1.0:1788863495.850043:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863495.850049:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001fdad644 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:6513:x1875759226421888:12345-0@lo:101: 00010000:00010000:1.0:1788863495.850056:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863495.850065:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9431f49/0xf569beb9d4b68868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68861 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850117:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9431f49/0xf569beb9d4b68868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68861 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850136:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9431f49/0xf569beb9d4b68868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68861 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850142:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9431f49, rc 0) 00000100:00100000:1.0:1788863495.850170:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001fdad644 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+7:6513:x1875759226421888:12345-0@lo:101: Request processed in 121us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863495.850175:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863495.850206:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226421888:0@lo:101: 00010000:00010000:1.0:1788863495.850216:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000008417e14/0xf569beb9d4b68861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850223:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000008417e14/0xf569beb9d4b68861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863495.850232:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788863495.850235:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000008417e14/0xf569beb9d4b68861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850240:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000008417e14/0xf569beb9d4b68861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863495.850245:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788863495.850260:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863495.850264:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e64a89a800 10000000:01000000:1.0:1788863495.850266:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788863495.850274:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788863495.850276:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863495.850289:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850295:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850301:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863495.850310:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422016:0@lo:101: 00000100:00100000:1.0:1788863495.850333:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863495.850355:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000276d0128 going to sleep for 11 seconds 00000100:00100000:1.0:1788863495.850366:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422016 00000100:00100000:1.0:1788863495.850370:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422016 00000100:00100000:1.0:1788863495.850386:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863495.850390:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006763aae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+7:6513:x1875759226422016:12345-0@lo:101: 00010000:00010000:1.0:1788863495.850397:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863495.850403:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6886f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850415:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850421:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850427:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e469776, rc 0) 00000100:00100000:1.0:1788863495.850452:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006763aae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+8:6513:x1875759226422016:12345-0@lo:101: Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863495.850463:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863495.850491:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422016:0@lo:101: 00010000:00010000:1.0:1788863495.850500:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863495.850506:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863495.850555:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422144:0@lo:501: 00000100:00100000:1.0:1788863495.850578:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863495.850590:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000276d0128 going to sleep for 11 seconds 00000100:00100000:1.0:1788863495.850602:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422144 00000100:00100000:1.0:1788863495.850606:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422144 00000100:00100000:1.0:1788863495.850622:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863495.850627:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b87e1fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+8:6513:x1875759226422144:12345-0@lo:501: 00000100:00100000:1.0:1788863495.850720:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b87e1fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6513:x1875759226422144:12345-0@lo:501: Request processed in 93us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863495.850726:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863495.850752:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422144:0@lo:501: 00000100:00100000:1.0:1788863495.850775:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422272:0@lo:503: 00000100:00100000:1.0:1788863495.850811:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863495.850823:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000276d0128 going to sleep for 11 seconds 00000100:00100000:1.0:1788863495.850836:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422272 00000100:00100000:1.0:1788863495.850840:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422272 00000100:00100000:1.0:1788863495.850856:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863495.850861:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000acefe815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6513:x1875759226422272:12345-0@lo:503: 00000100:00100000:1.0:1788863495.850935:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000acefe815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6513:x1875759226422272:12345-0@lo:503: Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863495.850942:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863495.850976:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422272:0@lo:503: 00000100:00100000:1.0:1788863495.852506:0:6558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6558:1875759226422400:0@lo:502: 00000100:00100000:1.0:1788863495.852646:0:6558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863495.852742:0:6558:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8308972 going to sleep for 11 seconds 00000100:00100000:2.0:1788863495.862680:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422400 00000100:00100000:2.0:1788863495.862698:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422400 00000100:00100000:2.0:1788863495.863144:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863495.863155:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d20afb04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6558:x1875759226422400:12345-0@lo:502: 00000100:00100000:2.0:1788863495.863521:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d20afb04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6558:x1875759226422400:12345-0@lo:502: Request processed in 367us (10875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863495.863529:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863495.863650:0:6558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6558:1875759226422400:0@lo:502: 00000020:01000000:1.0:1788863495.863699:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863495.863711:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863495.863713:0:6558:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788863495.863718:0:6558:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788863495.863721:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863495.863736:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006951258d) 00000020:00000080:1.0:1788863495.863755:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788863495.863760:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788863495.863884:0:6558:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788863495.863892:0:6558:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b68884 00000020:00000080:1.0:1788863495.864170:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788863495.864175:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863495.864179:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863495.864181:0:6558:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788863495.864184:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863495.864187:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863495.864188:0:6558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788863495.864191:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863495.864198:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d6dced59) 00000020:00000080:1.0:1788863495.864207:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788863495.864210:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788863495.864218:0:6558:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788863495.864221:0:6558:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788863495.864228:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788863495.865019:0:6558:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e94f401 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788863495.865039:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000852d2415) 00000020:00000080:1.0:1788863495.865048:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788863495.865373:0:6558:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788863495.865380:0:6558:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b68899 00000020:00000080:1.0:1788863495.865492:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788863495.865497:0:6558:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788863495.865516:0:6558:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf569beb9d4b688a0 00080000:01000000:1.0:1788863495.865521:0:6558:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788863495.865525:0:6558:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b688a7 00080000:10000000:1.0:1788863495.867820:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788863495.868715:0:6558:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788863495.881015:0:6558:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788863496.034785:0:6558:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788863496.035395:0:6558:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788863496.040581:0:6558:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788863496.041547:0:6558:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788863496.047904:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c124ebf7) 00000020:00000080:3.0:1788863496.050224:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788863496.050511:0:6558:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788863496.050523:0:6558:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b688b5 00000020:00000080:1.0:1788863496.060503:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788863496.061761:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788863496.065811:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788863496.070029:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788863496.076046:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788863496.079711:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788863496.083440:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788863496.086444:0:6558:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf569beb9d4b688bc 00000020:00000080:1.0:1788863496.086867:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788863496.086878:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863496.086884:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863496.086886:0:6558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788863496.086889:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863496.086894:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863496.086895:0:6558:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788863496.086905:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788863496.086906:0:6558:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788863496.086909:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863496.086911:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863496.086912:0:6558:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788863496.086914:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863496.086918:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863496.086919:0:6558:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788863496.086923:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788863496.086973:0:6558:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788863496.087030:0:6558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6558:1875759226422528:0@lo:502: 00000100:00100000:1.0:1788863496.087361:0:6558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863496.087414:0:6558:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3cd2b84 going to sleep for 11 seconds 00000100:00100000:3.0:1788863496.087661:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422528 00000100:00100000:3.0:1788863496.087668:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422528 00000100:00100000:3.0:1788863496.087715:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863496.087723:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002b7ffdf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6558:x1875759226422528:12345-0@lo:502: 00000100:00100000:3.0:1788863496.087852:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002b7ffdf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6558:x1875759226422528:12345-0@lo:502: Request processed in 130us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863496.087865:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863496.088484:0:6558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c923d6c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6558:1875759226422528:0@lo:502: 00000020:01000000:1.0:1788863496.088514:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863496.088521:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863496.088523:0:6558:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788863496.088527:0:6558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788863496.088812:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788863496.088896:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788863496.088953:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.088964:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863496.088972:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e64a89a800 from 1 10000000:01000000:3.0:1788863496.088975:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788863496.089023:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.089030:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.089039:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863496.089056:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056682991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422656:0@lo:101: 00000100:00100000:3.0:1788863496.089136:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.089173:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039689ae3 going to sleep for 11 seconds 00000100:00100000:1.0:1788863496.089489:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422656 00000100:00100000:1.0:1788863496.089496:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422656 00000100:00100000:1.0:1788863496.089659:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788863496.089669:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000062e68779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:6513:x1875759226422656:12345-0@lo:101: 00010000:00010000:1.0:1788863496.089681:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863496.089695:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b688c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863496.089717:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863496.089727:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863496.089744:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e9386cdc, rc 0) 00000100:00100000:1.0:1788863496.089790:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000062e68779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:6513:x1875759226422656:12345-0@lo:101: Request processed in 124us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863496.089797:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863496.089897:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056682991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422656:0@lo:101: 00010000:00010000:2.0:1788863496.089911:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.089921:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863496.090526:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005893908 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422784:0@lo:256: 00000100:00100000:2.0:1788863496.090895:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863496.090948:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f17dd2c going to sleep for 11 seconds 00000100:00100000:2.0:1788863496.091285:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422784 00000100:00100000:2.0:1788863496.091294:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422784 00000100:00100000:2.0:1788863496.091362:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863496.091371:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004877e6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:6513:x1875759226422784:12345-0@lo:256: 20000000:01000000:2.0:1788863496.091390:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788863496.091396:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788863496.091466:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004877e6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:6513:x1875759226422784:12345-0@lo:256: Request processed in 96us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863496.091472:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863496.091992:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005893908 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422784:0@lo:256: 10000000:01000000:2.0:1788863496.093360:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863496.093486:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.093499:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863496.095040:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e64a89a800 from 1 10000000:01000000:3.0:1788863496.095045:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863496.095394:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.095404:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.095428:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863496.095455:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422912:0@lo:101: 00000100:00100000:3.0:1788863496.095525:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.095712:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b74ba01c going to sleep for 11 seconds 00000100:00100000:2.0:1788863496.095785:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226422912 00000100:00100000:2.0:1788863496.095793:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226422912 00000100:00100000:2.0:1788863496.095851:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863496.095860:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000801c31e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:6513:x1875759226422912:12345-0@lo:101: 00010000:00010000:2.0:1788863496.095874:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863496.095888:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b688d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.095912:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.095922:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.096067:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008353d384, rc 0) 00000100:00100000:2.0:1788863496.096146:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000801c31e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:6513:x1875759226422912:12345-0@lo:101: Request processed in 287us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863496.096153:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863496.096354:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226422912:0@lo:101: 00010000:00010000:3.0:1788863496.096370:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.096379:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863496.096451:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423040:0@lo:501: 00000100:00100000:3.0:1788863496.096480:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.096514:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b74ba01c going to sleep for 11 seconds 00000100:00100000:0.0:1788863496.097445:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423040 00000100:00100000:0.0:1788863496.097455:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423040 00000100:00100000:0.0:1788863496.097502:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863496.097510:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000009bbcafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:6513:x1875759226423040:12345-0@lo:501: 00000100:00100000:0.0:1788863496.098062:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000009bbcafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:6513:x1875759226423040:12345-0@lo:501: Request processed in 552us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863496.098071:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788863496.098221:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423040:0@lo:501: 00000100:00100000:3.0:1788863496.098274:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423168:0@lo:503: 00000100:00100000:3.0:1788863496.098324:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.098354:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b74ba01c going to sleep for 11 seconds 00000100:00100000:3.0:1788863496.098369:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423168 00000100:00100000:3.0:1788863496.098373:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423168 00000100:00100000:3.0:1788863496.098396:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788863496.098402:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000098721090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:6513:x1875759226423168:12345-0@lo:503: 00000040:00080000:3.0:1788863496.098435:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788863496.098476:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000098721090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:6513:x1875759226423168:12345-0@lo:503: Request processed in 75us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863496.098483:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788863496.098525:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423168:0@lo:503: 00000040:00080000:0.0:1788863496.100446:0:6562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788863496.101058:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788863496.101321:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863496.101371:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.101385:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863496.101443:0:6513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788863496.101446:0:6513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e64a89a800 10000000:01000000:3.0:1788863496.101449:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e64a89a800 10000000:01000000:3.0:1788863496.101453:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788863496.101459:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e64a89a800 from 1 10000000:01000000:3.0:1788863496.101461:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788863496.101496:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.101504:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.101514:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863496.101657:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423296:0@lo:101: 00000100:00100000:3.0:1788863496.101725:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.101777:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4513ad4 going to sleep for 11 seconds 00000100:00100000:1.0:1788863496.101858:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423296 00000100:00100000:1.0:1788863496.101866:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423296 00000100:00100000:1.0:1788863496.102136:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863496.102147:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073e8b1b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:6513:x1875759226423296:12345-0@lo:101: 00010000:00010000:1.0:1788863496.102160:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863496.102173:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b688df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863496.102197:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b688df expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863496.102206:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b688df expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863496.102214:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069bc3f3c, rc 0) 00000100:00100000:1.0:1788863496.102385:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073e8b1b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6513:x1875759226423296:12345-0@lo:101: Request processed in 240us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863496.102393:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863496.102477:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423296:0@lo:101: 00010000:00010000:3.0:1788863496.102491:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.102499:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863496.102695:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423424:0@lo:501: 00000100:00100000:3.0:1788863496.102723:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.102757:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4513ad4 going to sleep for 11 seconds 00000100:00100000:1.0:1788863496.103448:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423424 00000100:00100000:1.0:1788863496.103456:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423424 00000100:00100000:1.0:1788863496.103485:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788863496.103491:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003c47b134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6513:x1875759226423424:12345-0@lo:501: 00000100:00100000:1.0:1788863496.103757:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003c47b134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6513:x1875759226423424:12345-0@lo:501: Request processed in 265us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863496.103775:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788863496.103866:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423424:0@lo:501: 00000100:00100000:3.0:1788863496.103910:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423552:0@lo:503: 00000100:00100000:3.0:1788863496.104212:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.104241:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4513ad4 going to sleep for 11 seconds 00000100:00100000:3.0:1788863496.104320:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423552 00000100:00100000:3.0:1788863496.104324:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423552 00000100:00100000:3.0:1788863496.104350:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863496.104356:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000078e5a633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6513:x1875759226423552:12345-0@lo:503: 00000100:00100000:3.0:1788863496.104434:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000078e5a633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6513:x1875759226423552:12345-0@lo:503: Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863496.104441:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863496.104485:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226423552:0@lo:503: 00000100:00100000:2.0:1788863496.105676:0:6563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005893908 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6563:1875759226423680:0@lo:502: 00000100:00100000:2.0:1788863496.105736:0:6563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863496.105774:0:6563:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093659ae2 going to sleep for 11 seconds 00000100:00100000:3.0:1788863496.106005:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423680 00000100:00100000:3.0:1788863496.106014:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423680 00000100:00100000:3.0:1788863496.106111:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788863496.106129:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eeabbfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6563:x1875759226423680:12345-0@lo:502: 00000100:00100000:3.0:1788863496.106240:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eeabbfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6563:x1875759226423680:12345-0@lo:502: Request processed in 123us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863496.106258:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863496.106339:0:6563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005893908 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6563:1875759226423680:0@lo:502: 00000020:01000004:2.0:1788863496.106396:0:6563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788863496.106412:0:6563:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e7fd3f39) 00000020:00000080:2.0:1788863496.106431:0:6563:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788863496.106528:0:6563:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e94f401 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788863496.106533:0:6563:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004e94f401 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788863496.106540:0:6563:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004e94f401 4 00010000:00080000:2.0:1788863496.106868:0:6563:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000552af359@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863496.110314:0:6563:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788863496.110663:0:6563:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788863496.110703:0:6563:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863496.110716:0:6563:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf569beb9d4b688f4 00000100:00080000:2.0:1788863496.110726:0:6563:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863496.110734:0:6563:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000552af359 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863496.110772:0:6563:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000005893908 x1875759226423808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863496.110803:0:6563:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788863496.111019:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005893908 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226423808:0@lo:38: 00000100:00100000:1.0:1788863496.111134:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863496.111685:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423808 00000100:00100000:2.0:1788863496.111695:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423808 00000100:00100000:2.0:1788863496.111753:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863496.111761:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c923d6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226423808:12345-0@lo:38: 00000100:00100000:2.0:1788863496.111841:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c923d6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226423808:12345-0@lo:38: Request processed in 80us (708us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788863496.111849:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863496.112167:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863496.112175:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000552af359 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863496.112179:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788863496.112183:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005893908 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226423808:0@lo:38: 00000100:00100000:2.0:1788863496.122623:0:6563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000597134cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6563:1875759226423936:0@lo:502: 00000100:00100000:2.0:1788863496.122718:0:6563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863496.122756:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226423936 00000100:00100000:2.0:1788863496.122763:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226423936 00000100:00100000:2.0:1788863496.122803:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863496.122810:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eb76595e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6563:x1875759226423936:12345-0@lo:502: 00000100:00100000:2.0:1788863496.122950:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eb76595e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6563:x1875759226423936:12345-0@lo:502: Request processed in 140us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863496.122957:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863496.123007:0:6563:0:(client.c:2716:ptlrpc_set_wait()) set 000000001667c03c going to sleep for 11 seconds 00000100:00100000:2.0:1788863496.123039:0:6563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000597134cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6563:1875759226423936:0@lo:502: 00000040:00080000:2.0:1788863496.123063:0:6563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788863496.124295:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788863496.124323:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863496.124343:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.124356:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788863496.124416:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788863496.124420:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788863496.124421:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863496.124422:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863496.124423:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863496.124424:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863496.124425:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788863496.124427:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788863496.124428:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863496.124429:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863496.124431:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863496.124432:0:6513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788863496.124435:0:6513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788863496.124438:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788863496.124439:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788863496.124440:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863496.124441:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863496.124441:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863496.124443:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863496.124443:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788863496.124444:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788863496.124445:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863496.124446:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863496.124446:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863496.124448:0:6513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788863496.124469:0:6513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788863496.124490:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000597134cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226424064:0@lo:253: 00000100:00100000:2.0:1788863496.124558:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863496.124579:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000321a55bd going to sleep for 11 seconds 00000100:00100000:3.0:1788863496.125150:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424064 00000100:00100000:3.0:1788863496.125158:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424064 00000100:00100000:3.0:1788863496.125204:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788863496.125212:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000de0bb641 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6513:x1875759226424064:12345-0@lo:253: 20000000:01000000:3.0:1788863496.125237:0:6532:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788863496.125359:0:6532:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788863496.133814:0:6532:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788863496.133842:0:6532:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788863496.134368:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788863496.134374:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788863496.134394:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.134414:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.134423:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.134464:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.134480:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 12 pid: 6529 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863496.134495:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226424192:0@lo:104: 00000100:00100000:3.0:1788863496.134635:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863496.134697:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set 00000000819f925e going to sleep for 11 seconds 00000100:00100000:2.0:1788863496.134858:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000de0bb641 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6513:x1875759226424064:12345-0@lo:253: Request processed in 9647us (10299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863496.134869:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788863496.135333:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000597134cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6513:1875759226424064:0@lo:253: 10000000:01000000:3.0:1788863496.135360:0:6513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788863496.135364:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788863496.135366:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788863496.135367:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863496.135368:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863496.135369:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863496.135371:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863496.135372:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863496.135373:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788863496.135375:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788863496.135376:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788863496.135377:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863496.135378:0:6513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788863496.135393:0:6513:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788863496.136096:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424192 00000100:00100000:1.0:1788863496.136106:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424192 00000100:00100000:1.0:1788863496.136235:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863496.136311:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007303e4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226424192:12345-0@lo:104: 00010000:00010000:1.0:1788863496.136330:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863496.136404:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863496.136410:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007303e4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226424192:12345-0@lo:104: Request processed in 169us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863496.136418:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788863496.136520:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863496.136525:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.136533:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000050169c77 already unused, calling callback (000000002e9b2fc7) 10000000:00010000:2.0:1788863496.136536:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.137004:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863496.137012:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863496.137018:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863496.137065:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.137072:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863496.137181:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.137189:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b688c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.137224:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863496.137226:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863496.137228:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863496.138688:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090da6aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226424320:0@lo:103: 00000100:00100000:0.0:1788863496.138757:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863496.141716:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424320 00000100:00100000:2.0:1788863496.141730:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424320 00010000:00010000:2.0:1788863496.141763:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 12 pid: 6529 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863496.141806:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863496.141814:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000039d7ff37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3641:x1875759226424320:12345-0@lo:103: 00010000:00010000:2.0:1788863496.141828:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863496.141831:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 12 pid: 6529 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141840:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 12 pid: 6529 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141861:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141868:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863496.141884:0:6522:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007510891s 00010000:00010000:2.0:1788863496.141888:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141894:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141917:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141924:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141944:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a7b9ef28 already unused, calling callback (0000000050850020) 00010000:00010000:2.0:1788863496.141947:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141953:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141961:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863496.141971:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863496.142041:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000039d7ff37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3641:x1875759226424320:12345-0@lo:103: Request processed in 227us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863496.142049:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863496.143281:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090da6aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226424320:0@lo:103: 00010000:00010000:3.0:1788863496.146718:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e9386cdc/0xf569beb9d4b688ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b688c3 expref: 11 pid: 6529 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863496.146740:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226424192:0@lo:104: 00010000:00010000:3.0:1788863496.146765:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.146774:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.146779:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863496.146784:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b688fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788863496.148425:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788863496.148924:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788863496.149779:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788863496.150397:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788863496.150765:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788863496.151314:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788863496.155513:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788863496.155734:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788863496.155946:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788863496.156744:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788863496.161705:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788863496.162019:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788863496.168858:0:6513:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788863496.186344:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788863496.186786:0:6569:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788863496.187442:0:6568:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788863496.187448:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788863496.190509:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788863496.197510:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863496.197693:0:6569:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788863496.198531:0:6513:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788863496.198553:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788863496.199430:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863496.205710:0:6513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788863496.209720:0:6513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788863496.209794:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788863496.210678:0:6569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788863496.210734:0:6569:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788863496.210737:0:6569:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788863496.211568:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788863496.211804:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788863496.213824:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788863496.214416:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788863496.214671:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788863496.214818:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788863496.215423:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788863496.215627:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788863496.215798:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788863496.216762:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788863496.217561:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788863496.217722:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788863496.219874:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788863496.220113:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788863496.220689:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788863496.220830:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788863496.221710:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788863496.221862:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788863496.222528:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788863496.222799:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788863496.223373:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788863496.223506:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788863496.223799:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788863496.224386:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788863496.224672:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788863496.224850:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788863496.225436:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788863496.225728:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788863496.225864:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788863496.226411:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788863496.226632:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788863496.227709:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788863496.227852:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788863496.228386:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788863496.228708:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788863496.235816:0:6513:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788863496.235857:0:6513:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4a9c1c3f988 00100000:10000000:1.0:1788863496.235865:0:6513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788863496.236748:0:6513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788863496.236764:0:6513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788863496.236780:0:6513:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788863496.236796:0:6513:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788863496.237832:0:6513:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863496.238408:0:6513:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788863496.370940:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863497.387384:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863498.419988:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863499.435646:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863500.460371:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863501.000326:0:6813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788863501.293014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788863501.293024:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788863501.293034:0:8:0:(import.c:65:import_set_state_nolock()) 00000000552af359 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788863501.293050:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000552af359 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863501.293092:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000026cb0e72 x1875759226424576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863501.293132:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026cb0e72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226424576:0@lo:38: 00000100:00100000:2.0:1788863501.293204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863501.298107:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b52dd36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226424448:0@lo:400: 00000100:00100000:0.0:1788863501.298193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863501.301688:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424448 00000100:00100000:1.0:1788863501.301707:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424448 00000100:00100000:1.0:1788863501.301777:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863501.301785:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b3f915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:3642:x1875759226424448:12345-0@lo:400: 00000100:00100000:1.0:1788863501.301882:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b3f915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:3642:x1875759226424448:12345-0@lo:400: Request processed in 98us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863501.301890:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863501.302184:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b52dd36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226424448:0@lo:400: 00000100:00100000:3.0:1788863501.302521:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424576 00000100:00100000:3.0:1788863501.302530:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424576 00000100:00100000:3.0:1788863501.302688:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863501.302696:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcbadc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226424576:12345-0@lo:38: 00010000:00080000:3.0:1788863501.302722:0:6538:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1788863501.302765:0:6538:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf569beb9d4b68902 00000004:00100000:3.0:1788863501.302803:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788863501.302918:0:6538:0:(import.c:65:import_set_state_nolock()) 00000000460b008b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863501.303109:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcbadc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875759226424576:12345-0@lo:38: Request processed in 411us (9905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863501.303116:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788863501.303505:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000026cb0e72 x1875759226424576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863501.303534:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788863501.303544:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788863501.303560:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788863501.303562:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000552af359 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788863501.303637:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026cb0e72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226424576:0@lo:38: 00010000:00010000:1.0:1788863501.485753:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788863501.975882:0:6866:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863501.978176:0:6866:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788863502.507366:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863503.531428:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788863504.364341:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788863504.364350:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e64a89a800 from 3 10000000:01000000:1.0:1788863504.364355:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788863504.364420:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863504.364433:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863504.364444:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863504.364472:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fcabeab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226424704:0@lo:101: 00000100:00100000:1.0:1788863504.364563:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863504.364656:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a831abbb going to sleep for 11 seconds 00000100:00100000:2.0:1788863504.364810:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424704 00000100:00100000:2.0:1788863504.364819:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424704 00000100:00100000:2.0:1788863504.364876:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788863504.364884:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000093a3ae57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:6534:x1875759226424704:12345-0@lo:101: 00010000:00010000:2.0:1788863504.364897:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863504.364911:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68909 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863504.364936:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863504.364946:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863504.364954:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b97c193, rc 0) 00000100:00100000:2.0:1788863504.365003:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000093a3ae57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6534:x1875759226424704:12345-0@lo:101: Request processed in 120us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863504.365010:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863504.365215:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fcabeab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226424704:0@lo:101: 00010000:00010000:3.0:1788863504.365231:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863504.365257:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863504.365304:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226424832:0@lo:256: 00000100:00100000:3.0:1788863504.365335:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863504.365368:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054c3df27 going to sleep for 11 seconds 00000100:00100000:1.0:1788863504.365475:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424832 00000100:00100000:1.0:1788863504.365479:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424832 00000100:00100000:1.0:1788863504.365524:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788863504.365530:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d813437b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6534:x1875759226424832:12345-0@lo:256: 20000000:01000000:1.0:1788863504.365551:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788863504.365566:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788863504.365569:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788863504.365889:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d813437b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:6534:x1875759226424832:12345-0@lo:256: Request processed in 359us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863504.365897:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863504.366793:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b51aa7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226424832:0@lo:256: 10000000:01000000:0.0:1788863504.366849:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788863504.366858:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863504.366867:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863504.559995:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863504.818678:0:6967:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863504.818847:0:6967:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788863505.579769:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863506.415016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005525f8f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226424960:0@lo:400: 00000100:00100000:1.0:1788863506.415152:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863506.415306:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fc13357 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226425088:0@lo:400: 00000100:00100000:0.0:1788863506.415356:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863506.415472:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425088 00000100:00100000:1.0:1788863506.415485:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425088 00000100:00100000:1.0:1788863506.415556:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863506.415567:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000733bd9c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226425088:12345-0@lo:400: 00000100:00100000:1.0:1788863506.415631:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000733bd9c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226425088:12345-0@lo:400: Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863506.415640:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788863506.415791:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009fc13357 x1875759226425088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863506.415808:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fc13357 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226425088:0@lo:400: 00000100:00100000:3.0:1788863506.416618:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226424960 00000100:00100000:3.0:1788863506.416628:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226424960 00000100:00100000:3.0:1788863506.416686:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863506.416695:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000a24222f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3643:x1875759226424960:12345-0@lo:400: 00000100:00100000:3.0:1788863506.416771:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000a24222f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3643:x1875759226424960:12345-0@lo:400: Request processed in 78us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863506.416778:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863506.416830:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005525f8f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226424960:0@lo:400: 00010000:00010000:0.0:1788863506.612208:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863507.646823:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863508.651896:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863509.680031:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863510.700240:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863511.536362:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f381f710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226425216:0@lo:400: 00000100:00100000:3.0:1788863511.536453:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863511.538052:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226425344:0@lo:400: 00000100:00100000:2.0:1788863511.538138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863511.538192:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425344 00000100:00100000:2.0:1788863511.538208:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425344 00000100:00100000:2.0:1788863511.538263:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863511.538272:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b5528f44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226425344:12345-0@lo:400: 00000100:00100000:2.0:1788863511.538339:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b5528f44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226425344:12345-0@lo:400: Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863511.538357:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788863511.538401:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000033040305 x1875759226425344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863511.538417:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226425344:0@lo:400: 00000100:00100000:2.0:1788863511.539966:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425216 00000100:00100000:2.0:1788863511.539977:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425216 00000100:00100000:2.0:1788863511.540031:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863511.540039:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000071d74170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3641:x1875759226425216:12345-0@lo:400: 00000100:00100000:2.0:1788863511.540136:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000071d74170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3641:x1875759226425216:12345-0@lo:400: Request processed in 98us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863511.540145:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863511.540364:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f381f710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226425216:0@lo:400: 00010000:00010000:0.0:1788863511.724703:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863512.747382:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863513.775373:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863514.796197:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788863515.747022:0:7466:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788863515.747028:0:7466:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788863515.747030:0:7466:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788863515.748691:0:7466:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e6b0f2cc 00000020:01000004:0.0:1788863515.748718:0:7466:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788863515.748730:0:7466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788863515.748744:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000007eb4ce26) 00000020:00000080:0.0:1788863515.748761:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788863515.820586:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788863515.824324:0:7466:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788863515.824417:0:7466:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788863515.860450:0:7466:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788863515.861977:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788863515.861992:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788863515.862004:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6891e 00000020:01000004:0.0:1788863515.862011:0:7466:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788863515.862035:0:7466:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788863515.862038:0:7466:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788863515.862046:0:7466:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788863515.862072:0:7466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788863515.862090:0:7466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788863515.908530:0:7466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788863515.908571:0:7466:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.135@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788863515.908576:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788863515.908578:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788863515.908579:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863515.908581:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863515.908582:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863515.908583:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863515.908584:0:7466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863515.908586:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863515.908587:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863515.908592:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863515.908593:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863515.908595:0:7466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788863515.908597:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863515.908683:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788863515.908684:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863515.908685:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863515.908686:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863515.908687:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863515.908688:0:7466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863515.908689:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863515.908690:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863515.908691:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863515.908691:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863515.908721:0:7466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788863515.908740:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fc13357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226425472:0@lo:253: 00000100:00100000:0.0:1788863515.910834:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863515.910950:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000269585dd going to sleep for 11 seconds 00000100:00100000:1.0:1788863515.915019:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425472 00000100:00100000:1.0:1788863515.915038:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425472 00000100:00100000:0.0:1788863515.921527:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863515.921543:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e0628b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226425472:12345-0@lo:253: 20000000:01000000:0.0:1788863515.921586:0:6530:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788863515.921591:0:6530:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788863515.921595:0:6530:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788863515.921611:0:6530:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788863515.921665:0:6530:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788863515.921941:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863515.922145:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788863515.922163:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788863515.922193:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788863515.922210:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788863515.922245:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788863515.922646:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788863515.922655:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788863515.922667:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788863515.922681:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788863515.922695:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788863515.922700:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788863515.922712:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788863515.922726:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788863515.922836:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788863515.922846:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:0.0:1788863515.922859:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788863515.922864:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788863515.922878:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788863515.922882:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:0.0:1788863515.922894:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788863515.922900:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788863515.922911:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788863515.922925:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788863515.922935:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788863515.923012:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788863515.923022:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788863515.923032:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788863515.923046:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788863515.923071:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788863515.924932:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788863515.924992:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788863515.925022:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788863515.925029:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788863515.925098:0:6530:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788863515.925107:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788863515.930513:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788863515.931515:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788863515.931551:0:6530:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.135@tcp for mdt 20000000:01000000:1.0:1788863515.931567:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:1.0:1788863515.931590:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788863515.931610:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788863515.931638:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788863515.931645:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:1.0:1788863515.931662:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788863515.931670:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788863515.931684:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788863515.931697:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788863515.931752:0:6530:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788863515.931762:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788863515.934635:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788863515.936308:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788863515.936346:0:6530:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.135@tcp for mdt 20000000:01000000:1.0:1788863515.936349:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:1.0:1788863515.936366:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788863515.936372:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788863515.936384:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788863515.936389:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:1.0:1788863515.936401:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788863515.936409:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788863515.936421:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788863515.936436:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788863515.936461:0:6530:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788863515.936464:0:6530:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788863515.936469:0:6530:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788863515.936522:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788863515.936524:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788863515.937366:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788863515.937424:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788863515.937439:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788863515.937644:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788863515.937668:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788863515.937697:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788863515.937710:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788863515.937712:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788863515.944991:0:7475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788863515.945048:0:7475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788863515.945063:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788863515.945763:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788863515.945814:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788863515.945841:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788863515.945855:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788863515.945857:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788863515.946446:0:7476:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788863515.946470:0:7476:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788863515.946485:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788863515.946666:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788863515.946690:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788863515.946705:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788863515.946718:0:6530:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788863515.946720:0:6530:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788863515.946726:0:6530:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788863515.946732:0:6530:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788863515.947145:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788863515.947269:0:6530:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788863515.966514:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788863515.966568:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.966589:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.966596:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.967763:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b688df expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.967772:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.967823:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b688df expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.967839:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b688df expref: 12 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.967855:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003890c9a6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226425600:0@lo:104: 00000100:00100000:1.0:1788863515.967951:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863515.968015:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.968022:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 12 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.968029:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000584a4794 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226425728:0@lo:104: 00000100:00100000:1.0:1788863515.968049:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863515.968095:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425600 00000100:00100000:1.0:1788863515.968103:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425600 00000100:00100000:1.0:1788863515.968147:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425728 00000100:00100000:1.0:1788863515.968150:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425728 00000100:00100000:1.0:1788863515.968164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863515.968172:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000b92ec04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6530:x1875759226425600:12345-0@lo:104: 00010000:00010000:1.0:1788863515.968184:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.968240:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863515.968245:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000b92ec04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6530:x1875759226425600:12345-0@lo:104: Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863515.968252:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863515.968282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863515.968289:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000418d18e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226425728:12345-0@lo:104: 00010000:00010000:1.0:1788863515.968295:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.968324:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788863515.968328:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000418d18e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226425728:12345-0@lo:104: Request processed in 42us (279us total) trans 0 rc 0/0 00010000:00010000:0.0:1788863515.968338:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788863515.968340:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788863515.968344:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968351:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d8251f7f already unused, calling callback (000000002e9b2fc7) 10000000:00010000:0.0:1788863515.968354:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968362:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863515.968369:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.968371:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863515.968376:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863515.968378:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 12 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.968386:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226425856:0@lo:104: 00010000:00010000:0.0:1788863515.968402:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.968407:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863515.968408:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788863515.968424:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425856 00000100:00100000:1.0:1788863515.968427:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425856 00010000:00010000:0.0:1788863515.968428:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968434:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 00000000d8251f7f/0xf569beb9d4b688df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.968441:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863515.968445:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000287bdabc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226425856:12345-0@lo:104: 00010000:00010000:0.0:1788863515.968449:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863515.968450:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968457:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968462:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dee1b91e already unused, calling callback (000000002e9b2fc7) 10000000:00010000:0.0:1788863515.968464:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968469:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.968472:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:0.0:1788863515.968475:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.968476:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000287bdabc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226425856:12345-0@lo:104: Request processed in 31us (69us total) trans 0 rc 0/0 10000000:01000000:0.0:1788863515.968480:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788863515.968482:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788863515.968492:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.968496:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788863515.968497:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788863515.968505:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226425984:0@lo:103: 00010000:00010000:0.0:1788863515.968508:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968513:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b6886f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968523:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863515.968524:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.968529:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863515.968530:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007084655d already unused, calling callback (000000002e9b2fc7) 10000000:00010000:0.0:1788863515.968532:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968547:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863515.968553:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863515.968557:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788863515.968558:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068456512 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226426112:0@lo:103: 00010000:00010000:0.0:1788863515.968569:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968574:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863515.968578:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968583:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 000000007084655d/0xf569beb9d4b68853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6885a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.968597:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863515.968598:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863515.968599:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863515.969400:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000307d9dfc going to sleep for 11 seconds 00000100:00100000:0.0:1788863515.969435:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003890c9a6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226425600:0@lo:104: 00000100:00100000:0.0:1788863515.969444:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000584a4794 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226425728:0@lo:104: 00000100:00100000:0.0:1788863515.969450:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226425856:0@lo:104: 00010000:00010000:0.0:1788863515.969472:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863515.970112:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226425984 00000100:00100000:2.0:1788863515.970123:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226425984 00010000:00010000:2.0:1788863515.970165:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b688df expref: 13 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863515.970218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863515.970239:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000035e50e99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:3642:x1875759226425984:12345-0@lo:103: 00010000:00010000:2.0:1788863515.970253:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863515.970269:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b688df expref: 13 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.970279:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b688df expref: 13 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.970294:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b688e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b688df expref: 13 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.970310:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863515.970377:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000035e50e99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3642:x1875759226425984:12345-0@lo:103: Request processed in 140us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863515.970383:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863515.970701:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226425984:0@lo:103: 00010000:00010000:3.0:1788863515.970703:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863515.970727:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d35cb6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226426240:0@lo:103: 00000100:00100000:3.0:1788863515.970766:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863515.971317:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226426240 00000100:00100000:2.0:1788863515.971324:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226426240 00010000:00010000:2.0:1788863515.971348:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 12 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863515.971377:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863515.971384:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b4c9628c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:3641:x1875759226426240:12345-0@lo:103: 00010000:00010000:2.0:1788863515.971393:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863515.971397:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 12 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.971406:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 12 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.971417:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b6885a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68853 expref: 12 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.971437:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863515.971468:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b4c9628c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:3641:x1875759226426240:12345-0@lo:103: Request processed in 85us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863515.971475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863515.971548:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d35cb6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226426240:0@lo:103: 00000100:00100000:1.0:1788863515.972438:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863515.972743:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226426112 00000100:00100000:2.0:1788863515.972753:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226426112 00010000:00010000:2.0:1788863515.972783:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 11 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863515.972812:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863515.972819:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000373d9da9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:3640:x1875759226426112:12345-0@lo:103: 00010000:00010000:2.0:1788863515.972831:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863515.972835:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 11 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972845:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 11 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972859:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008e469776/0xf569beb9d4b68876 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6886f expref: 11 pid: 6529 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972871:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972878:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972895:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972916:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972922:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972929:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972936:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004f9569a9 already unused, calling callback (0000000050850020) 00010000:00010000:2.0:1788863515.972939:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972948:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972963:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.972976:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863515.973024:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000373d9da9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:3640:x1875759226426112:12345-0@lo:103: Request processed in 206us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863515.973031:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863515.973295:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068456512 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226426112:0@lo:103: 00010000:00010000:0.0:1788863515.974001:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.974013:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.974019:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f9569a9/0xf569beb9d4b68925 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788863515.974045:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788863515.981488:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e0628b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:7466:x1875759226425472:12345-0@lo:253: Request processed in 59941us (70654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863515.981506:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863515.986143:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fc13357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226425472:0@lo:253: 10000000:01000000:2.0:1788863515.986184:0:7466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788863515.986188:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788863515.986190:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788863515.986192:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863515.986193:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788863515.986194:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863515.986212:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863515.986214:0:7466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788863515.986215:0:7466:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788863515.986217:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863515.986218:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788863515.986243:0:7466:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e6b0f2cc from lustre-MDT0001 10000000:01000000:2.0:1788863515.986291:0:7466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788863515.986294:0:7466:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788863515.986300:0:7466:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e671354d40 local copy 10000000:01000000:2.0:1788863515.986305:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788863515.986351:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.986363:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.986372:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863515.986396:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005db088ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426368:0@lo:101: 00000100:00100000:2.0:1788863515.986470:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863515.986525:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063118b21 going to sleep for 11 seconds 00000100:00100000:3.0:1788863515.986764:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226426368 00000100:00100000:3.0:1788863515.986772:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226426368 00000100:00100000:3.0:1788863515.986830:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788863515.986838:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000169f7d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:7466:x1875759226426368:12345-0@lo:101: 00010000:00010000:3.0:1788863515.986852:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863515.986867:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b68933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6892c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.986892:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b68933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6892c expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.986902:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b68933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6892c expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.986911:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7b9ef28, rc 0) 00000100:00100000:3.0:1788863515.986960:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000169f7d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:7466:x1875759226426368:12345-0@lo:101: Request processed in 123us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863515.986967:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863515.987052:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005db088ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426368:0@lo:101: 00010000:00010000:0.0:1788863515.987066:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.987110:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863515.987234:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426496:0@lo:501: 00000100:00100000:0.0:1788863515.987272:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863515.987297:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000004122971e going to sleep for 11 seconds 00000100:00100000:3.0:1788863515.987405:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226426496 00000100:00100000:3.0:1788863515.987411:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226426496 00000100:00100000:3.0:1788863515.987444:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788863515.987451:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000004b66222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:7466:x1875759226426496:12345-0@lo:501: 00000100:00100000:3.0:1788863515.987520:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000004b66222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:7466:x1875759226426496:12345-0@lo:501: Request processed in 70us (248us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863515.987529:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863515.987601:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426496:0@lo:501: 10000000:01000000:0.0:1788863515.987615:0:7466:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788863515.987633:0:7466:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788863515.987638:0:7466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.987659:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.987665:0:7466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.987690:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788863515.987713:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e648f4b800 10000000:01000000:0.0:1788863515.987718:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788863515.987722:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89e671354d40 10000000:01000000:0.0:1788863515.987726:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788863515.987729:0:7466:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89e671354d40 from 1 10000000:01000000:0.0:1788863515.987731:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788863515.987749:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000e58c3e79/0xf569beb9d4b6893a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.987756:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000e58c3e79/0xf569beb9d4b6893a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.987764:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000e58c3e79/0xf569beb9d4b6893a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863515.987776:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426624:0@lo:101: 00000100:00100000:0.0:1788863515.987801:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863515.987813:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092f9e090 going to sleep for 11 seconds 00010000:00010000:3.0:1788863515.987865:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863515.987872:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.987880:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066495795 already unused, calling callback (000000002e9b2fc7) 10000000:00010000:3.0:1788863515.987882:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.987897:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863515.987903:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863515.987909:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863515.987928:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.987935:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863515.987963:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.987969:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b6892c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68933 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.987985:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863515.987987:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863515.987988:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863515.987996:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863515.988007:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57edc9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226426752:0@lo:103: 00000100:00100000:3.0:1788863515.988034:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863515.988066:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226426752 00000100:00100000:3.0:1788863515.988070:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226426752 00000100:00100000:3.0:1788863515.988131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863515.988139:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000086cfae81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:3643:x1875759226426752:12345-0@lo:103: 00010000:00010000:3.0:1788863515.988159:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863515.988172:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b68933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6892c expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.988192:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863515.988219:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000086cfae81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:3643:x1875759226426752:12345-0@lo:103: Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863515.988226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863515.988252:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57edc9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226426752:0@lo:103: 00000100:00100000:3.0:1788863515.988283:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226426624 00000100:00100000:3.0:1788863515.988286:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226426624 00000100:00100000:3.0:1788863515.988305:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788863515.988311:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c09221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+9:7466:x1875759226426624:12345-0@lo:101: 00010000:00010000:3.0:1788863515.988319:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863515.988329:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2b36e54/0xf569beb9d4b68941 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6893a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.988344:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2b36e54/0xf569beb9d4b68941 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6893a expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.988352:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2b36e54/0xf569beb9d4b68941 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6893a expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863515.988358:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2b36e54, rc 0) 00000100:00100000:3.0:1788863515.988383:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c09221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:7466:x1875759226426624:12345-0@lo:101: Request processed in 73us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863515.988388:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863515.988725:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426624:0@lo:101: 00010000:00010000:0.0:1788863515.988738:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000e58c3e79/0xf569beb9d4b6893a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68941 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.988756:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000e58c3e79/0xf569beb9d4b6893a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68941 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863515.988770:0:7466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788863515.988785:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000e58c3e79/0xf569beb9d4b6893a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68941 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.988792:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000e58c3e79/0xf569beb9d4b6893a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68941 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863515.988800:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e648f4b800 10000000:01000000:0.0:1788863515.988804:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788863515.988808:0:7466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89e648f4b800 from 1 10000000:01000000:0.0:1788863515.988809:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788863515.988825:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000000ccfa9b1/0xf569beb9d4b68948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.988831:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000000ccfa9b1/0xf569beb9d4b68948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.988837:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000000ccfa9b1/0xf569beb9d4b68948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863515.988850:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426880:0@lo:101: 00000100:00100000:0.0:1788863515.988878:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863515.988903:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092f9e090 going to sleep for 11 seconds 00000100:00100000:2.0:1788863515.989004:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226426880 00000100:00100000:2.0:1788863515.989009:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226426880 00000100:00100000:2.0:1788863515.989043:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788863515.989050:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c88fde25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+10:7466:x1875759226426880:12345-0@lo:101: 00010000:00010000:2.0:1788863515.989058:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863515.989066:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000317fe19e/0xf569beb9d4b6894f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68948 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.989103:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000317fe19e/0xf569beb9d4b6894f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68948 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.989123:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000317fe19e/0xf569beb9d4b6894f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68948 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863515.989130:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000317fe19e, rc 0) 00000100:00100000:2.0:1788863515.989173:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c88fde25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:7466:x1875759226426880:12345-0@lo:101: Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863515.989179:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863515.989310:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226426880:0@lo:101: 00010000:00010000:1.0:1788863515.989327:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000000ccfa9b1/0xf569beb9d4b68948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.989334:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000000ccfa9b1/0xf569beb9d4b68948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863515.989345:0:7466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788863515.989358:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000000ccfa9b1/0xf569beb9d4b68948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.989365:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000000ccfa9b1/0xf569beb9d4b68948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863515.989370:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788863515.989374:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863515.989378:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e648f4b800 10000000:01000000:1.0:1788863515.989380:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788863515.989383:0:7466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788863515.989385:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788863515.989401:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000006b6fdad8/0xf569beb9d4b68956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.989407:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000006b6fdad8/0xf569beb9d4b68956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.989413:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000006b6fdad8/0xf569beb9d4b68956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.989425:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427008:0@lo:101: 00000100:00100000:1.0:1788863515.989449:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863515.989467:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f3a367e going to sleep for 11 seconds 00000100:00100000:0.0:1788863515.989523:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427008 00000100:00100000:0.0:1788863515.989526:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427008 00000100:00100000:0.0:1788863515.989550:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863515.989555:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a258519d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+11:7466:x1875759226427008:12345-0@lo:101: 00010000:00010000:0.0:1788863515.989561:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863515.989569:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f689b4a/0xf569beb9d4b6895d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68956 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.989580:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f689b4a/0xf569beb9d4b6895d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.989587:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f689b4a/0xf569beb9d4b6895d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863515.989592:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f689b4a, rc 0) 00000100:00100000:0.0:1788863515.989623:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a258519d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427008:12345-0@lo:101: Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863515.989629:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863515.989684:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427008:0@lo:101: 00010000:00010000:1.0:1788863515.989693:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000006b6fdad8/0xf569beb9d4b68956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863515.989699:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000006b6fdad8/0xf569beb9d4b68956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863515.989775:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427136:0@lo:501: 00000100:00100000:1.0:1788863515.989798:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863515.989824:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f3a367e going to sleep for 11 seconds 00000100:00100000:3.0:1788863515.989899:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427136 00000100:00100000:3.0:1788863515.989903:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427136 00000100:00100000:3.0:1788863515.989922:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788863515.989927:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000052ac2036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427136:12345-0@lo:501: 00000100:00100000:3.0:1788863515.990038:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000052ac2036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427136:12345-0@lo:501: Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863515.990045:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863515.990192:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427136:0@lo:501: 00000100:00100000:1.0:1788863515.990217:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427264:0@lo:503: 00000100:00100000:1.0:1788863515.990253:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863515.990286:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f3a367e going to sleep for 11 seconds 00000100:00100000:2.0:1788863515.990526:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427264 00000100:00100000:2.0:1788863515.990532:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427264 00000100:00100000:2.0:1788863515.990564:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863515.990570:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073b5f872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427264:12345-0@lo:503: 00000100:00100000:2.0:1788863515.990667:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073b5f872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427264:12345-0@lo:503: Request processed in 97us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863515.990673:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863515.990805:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427264:0@lo:503: 00000040:00080000:1.0:1788863515.991298:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863515.991375:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427392:0@lo:502: 00000100:00100000:1.0:1788863515.991418:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863515.991449:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f3a367e going to sleep for 11 seconds 00000100:00100000:2.0:1788863515.991525:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427392 00000100:00100000:2.0:1788863515.991531:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427392 00000100:00100000:2.0:1788863515.991566:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788863515.991572:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000069a7a26a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427392:12345-0@lo:502: 00000100:00100000:2.0:1788863515.991666:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000069a7a26a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427392:12345-0@lo:502: Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863515.991673:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863515.991831:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427392:0@lo:502: 00000040:00080000:1.0:1788863515.992035:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788863515.992060:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788863515.992072:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788863515.992827:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788863515.992840:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788863515.992852:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788863515.992881:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788863515.992893:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788863515.992905:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788863515.992919:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788863515.992933:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788863515.992944:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788863515.992956:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788863515.992968:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788863515.992981:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788863515.992994:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788863515.993004:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788863515.993015:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788863515.993043:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788863515.993057:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788863515.993069:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788863515.993112:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788863515.993127:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788863515.996699:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427520:0@lo:502: 00000100:00100000:0.0:1788863515.996811:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863515.996878:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c89272e going to sleep for 11 seconds 00000100:00100000:1.0:1788863515.997119:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427520 00000100:00100000:1.0:1788863515.997129:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427520 00000100:00100000:1.0:1788863515.997194:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863515.997203:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000ed71ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427520:12345-0@lo:502: 00000100:00100000:1.0:1788863515.997364:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000ed71ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427520:12345-0@lo:502: Request processed in 163us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863515.997372:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788863515.997652:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427520:0@lo:502: 00000040:00080000:0.0:1788863515.997743:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788863515.997758:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788863515.998373:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863515.998386:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863515.998389:0:7478:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788863515.998394:0:7478:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788863515.998397:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863515.998411:0:7478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000ce812105) 00000020:00000080:2.0:1788863515.998440:0:7478:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788863515.998447:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788863515.998531:0:7478:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788863515.998538:0:7478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6896b 00000020:00000080:2.0:1788863515.998751:0:7478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788863515.998755:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863515.998759:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863515.998760:0:7478:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788863515.998763:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863515.998766:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863515.998768:0:7478:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788863515.998771:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863515.998777:0:7478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000b73b84ac) 00000020:00000080:2.0:1788863515.998788:0:7478:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788863515.998792:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788863515.998794:0:7478:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788863515.998797:0:7478:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788863515.998803:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788863515.998844:0:7478:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e6b0f2cc from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788863515.998867:0:7478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000001f42e1d9) 00000020:00000080:2.0:1788863515.998877:0:7478:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788863515.998947:0:7478:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788863515.998953:0:7478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b68980 00000020:00000080:2.0:1788863515.999037:0:7478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788863515.999043:0:7478:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788863515.999047:0:7478:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf569beb9d4b68987 00080000:01000000:2.0:1788863515.999052:0:7478:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788863515.999055:0:7478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6898e 00080000:10000000:3.0:1788863515.999807:0:7478:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788863515.999937:0:7478:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788863516.086659:0:7478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788863516.086942:0:7478:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788863516.091916:0:7478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788863516.092353:0:7478:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788863516.112424:0:7478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788863516.112439:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863516.112447:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.112450:0:7478:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788863516.112453:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863516.112459:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.112461:0:7478:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788863516.112465:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788863516.112471:0:7478:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:3.0:1788863516.112500:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788863516.112622:0:7478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000047444dae) 00000020:00000080:3.0:1788863516.112647:0:7478:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788863516.112654:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788863516.112719:0:7478:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788863516.112727:0:7478:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788863516.112733:0:7478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6899c 00010000:00080000:3.0:1788863516.112768:0:7478:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002061ffb1@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788863516.117751:0:7478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788863516.120421:0:7478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788863516.120441:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788863516.120499:0:7478:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788863516.120898:0:7478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b689a3 00000100:00080000:3.0:1788863516.120910:0:7478:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863516.120922:0:7478:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000002061ffb1 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863516.120962:0:7478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d57edc9e x1875759226427648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863516.120992:0:7478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788863516.121056:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863516.121063:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.121065:0:7478:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788863516.121068:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788863516.121071:0:7478:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788863516.121073:0:7478:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788863516.121103:0:7478:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788863516.121104:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788863516.121109:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.121111:0:7478:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788863516.121114:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863516.121120:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.121121:0:7478:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788863516.121126:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788863516.121165:0:7478:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788863516.121180:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863516.121184:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.121185:0:7478:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788863516.121188:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863516.121191:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.121193:0:7478:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863516.121197:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863516.121198:0:7478:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788863516.121226:0:7478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863516.121229:0:7478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863516.121238:0:7478:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788863516.121242:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1788863516.121327:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788863516.121359:0:7466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788863516.121374:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000006b6fdad8/0xf569beb9d4b68956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.121385:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000006b6fdad8/0xf569beb9d4b68956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863516.121393:0:7466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e648f4b800 from 1 10000000:01000000:3.0:1788863516.121396:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788863516.121425:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.121432:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.121443:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863516.121463:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5d211b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427776:0@lo:101: 00000100:00100000:3.0:1788863516.124631:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863516.124731:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000006951352e going to sleep for 11 seconds 00000100:00100000:2.0:1788863516.124761:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427776 00000100:00100000:2.0:1788863516.124779:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427776 00000100:00100000:2.0:1788863516.124858:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863516.124868:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000016f6d205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+12:7466:x1875759226427776:12345-0@lo:101: 00010000:00010000:2.0:1788863516.124893:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863516.124936:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b689aa expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863516.124964:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788863516.124975:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863516.124981:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dca67f92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226427904:0@lo:400: 00010000:00010000:2.0:1788863516.124998:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863516.125013:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089200dca, rc 0) 00000100:00100000:0.0:1788863516.125045:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.125121:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427904 00000100:00100000:0.0:1788863516.125129:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427904 00000100:00100000:2.0:1788863516.125176:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000016f6d205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:7466:x1875759226427776:12345-0@lo:101: Request processed in 307us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863516.125195:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788863516.125195:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863516.125211:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001297300b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226427904:12345-0@lo:400: 00000100:00100000:0.0:1788863516.125312:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001297300b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226427904:12345-0@lo:400: Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863516.125320:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863516.125440:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57edc9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226427648:0@lo:38: 00010000:00080000:2.0:1788863516.125493:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dca67f92 x1875759226427904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863516.125523:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dca67f92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226427904:0@lo:400: 00000100:00100000:3.0:1788863516.134219:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5d211b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226427776:0@lo:101: 00000100:00100000:1.0:1788863516.134223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863516.134254:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.134278:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863516.134338:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226427648 00000100:00100000:2.0:1788863516.134356:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226427648 00000100:00100000:2.0:1788863516.134422:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863516.134437:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000019e92c15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226427648:12345-0@lo:38: 00010000:00080000:2.0:1788863516.134488:0:6541:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1788863516.134558:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b689b8 00000004:00100000:2.0:1788863516.134587:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788863516.134598:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788863516.136230:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5d211b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428032:0@lo:256: 00000100:00100000:3.0:1788863516.136321:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863516.136370:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000006951352e going to sleep for 11 seconds 00000100:00100000:2.0:1788863516.140419:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428032 00000100:00100000:2.0:1788863516.140448:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428032 00000100:00100000:2.0:1788863516.140624:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863516.140645:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000095ae09e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:7466:x1875759226428032:12345-0@lo:256: 20000000:01000000:2.0:1788863516.140710:0:6532:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788863516.140740:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788863516.140747:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788863516.140946:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000095ae09e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:7466:x1875759226428032:12345-0@lo:256: Request processed in 311us (4625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863516.140955:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863516.141229:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5d211b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428032:0@lo:256: 10000000:01000000:3.0:1788863516.142029:0:7466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788863516.142055:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.142068:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863516.142189:0:7466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e648f4b800 from 1 10000000:01000000:2.0:1788863516.142201:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863516.142289:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863516.142302:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863516.142314:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863516.142354:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c995f96a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428160:0@lo:101: 00000100:00100000:2.0:1788863516.142469:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863516.142583:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003588a71 going to sleep for 11 seconds 00000100:00100000:3.0:1788863516.142812:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428160 00000100:00100000:3.0:1788863516.142828:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428160 00000100:00100000:3.0:1788863516.142980:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863516.142998:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004c023108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:7466:x1875759226428160:12345-0@lo:101: 00010000:00010000:3.0:1788863516.143026:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863516.143051:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b689bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.143174:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.143194:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.143208:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001bbee2c, rc 0) 00000100:00100000:3.0:1788863516.143311:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004c023108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:7466:x1875759226428160:12345-0@lo:101: Request processed in 319us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863516.143390:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c995f96a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428160:0@lo:101: 00010000:00010000:0.0:1788863516.143418:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863516.143429:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863516.143565:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077d2907c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428288:0@lo:501: 00000100:00100000:0.0:1788863516.144008:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863516.145058:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863516.159633:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000feeaa030 going to sleep for 11 seconds 00000100:00100000:3.0:1788863516.160015:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428288 00000100:00100000:3.0:1788863516.160036:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428288 00000100:00100000:3.0:1788863516.160119:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863516.160270:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000be9982c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:7466:x1875759226428288:12345-0@lo:501: 00000100:00100000:3.0:1788863516.162441:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000be9982c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:7466:x1875759226428288:12345-0@lo:501: Request processed in 2173us (18421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863516.162461:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863516.162962:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077d2907c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428288:0@lo:501: 00000100:00100000:0.0:1788863516.163444:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077d2907c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428416:0@lo:503: 00000100:00080000:3.0:1788863516.163855:0:6541:0:(import.c:65:import_set_state_nolock()) 00000000297d860c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863516.163890:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.163969:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000feeaa030 going to sleep for 11 seconds 00000100:00100000:3.0:1788863516.163978:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000019e92c15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226427648:12345-0@lo:38: Request processed in 29539us (29752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.164027:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863516.164041:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788863516.164053:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788863516.164062:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788863516.164102:0:3639:0:(import.c:65:import_set_state_nolock()) 000000002061ffb1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788863516.164119:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57edc9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226427648:0@lo:38: 00000100:00100000:2.0:1788863516.164235:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428416 00000100:00100000:2.0:1788863516.164248:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428416 00000100:00100000:2.0:1788863516.164324:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788863516.164334:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c4b00b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:7466:x1875759226428416:12345-0@lo:503: 00000040:00080000:2.0:1788863516.164409:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788863516.164498:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863516.164533:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863516.164545:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009d6cd68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226428544:0@lo:41: 00000100:00100000:3.0:1788863516.164742:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863516.165364:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c4b00b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:7466:x1875759226428416:12345-0@lo:503: Request processed in 1029us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863516.165375:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788863516.165508:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077d2907c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428416:0@lo:503: 00000040:00080000:1.0:1788863516.165905:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863516.165977:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788863516.166142:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863516.166673:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428544 00000100:00100000:0.0:1788863516.166691:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428544 00000100:00100000:3.0:1788863516.166943:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863516.166956:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c5d211b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226428544:12345-0@lo:41: 00000004:00000024:3.0:1788863516.166994:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788863516.167141:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c5d211b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226428544:12345-0@lo:41: Request processed in 188us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863516.167148:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:1.0:1788863516.167272:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00100000:2.0:1788863516.167798:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009d6cd68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226428544:0@lo:41: 00000020:01000000:3.0:1788863516.167906:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788863516.167944:0:7466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863516.167968:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.167981:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863516.168105:0:7466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788863516.168111:0:7466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e648f4b800 10000000:01000000:3.0:1788863516.168115:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e648f4b800 10000000:01000000:3.0:1788863516.168121:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788863516.168129:0:7466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e648f4b800 from 1 10000000:01000000:3.0:1788863516.168132:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863516.168248:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000083b75811/0xf569beb9d4b689cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863516.168275:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000083b75811/0xf569beb9d4b689cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863516.168284:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000083b75811/0xf569beb9d4b689cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863516.168332:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019a119f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428672:0@lo:101: 00000100:00100000:0.0:1788863516.168399:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.168452:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b10389c going to sleep for 11 seconds 00000100:00100000:3.0:1788863516.168643:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428672 00000100:00100000:3.0:1788863516.168652:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428672 00000100:00100000:3.0:1788863516.168702:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863516.168710:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007e76a96c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:7466:x1875759226428672:12345-0@lo:101: 00010000:00010000:3.0:1788863516.168725:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863516.168743:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d8251f7f/0xf569beb9d4b689d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b689cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.168769:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8251f7f/0xf569beb9d4b689d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.168780:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d8251f7f/0xf569beb9d4b689d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.168789:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d8251f7f, rc 0) 00000100:00100000:3.0:1788863516.168854:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007e76a96c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226428672:12345-0@lo:101: Request processed in 144us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863516.168860:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788863516.169164:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019a119f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428672:0@lo:101: 00010000:00010000:0.0:1788863516.169188:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000083b75811/0xf569beb9d4b689cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863516.169199:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000083b75811/0xf569beb9d4b689cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863516.169333:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428800:0@lo:501: 00000100:00100000:0.0:1788863516.169368:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.169405:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b10389c going to sleep for 11 seconds 00000100:00100000:2.0:1788863516.169432:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428800 00000100:00100000:2.0:1788863516.169441:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428800 00000100:00100000:2.0:1788863516.169497:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863516.169504:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003857deb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226428800:12345-0@lo:501: 00000100:00100000:2.0:1788863516.169669:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003857deb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226428800:12345-0@lo:501: Request processed in 165us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863516.169676:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863516.169889:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428800:0@lo:501: 00000100:00100000:0.0:1788863516.169923:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428928:0@lo:503: 00000100:00100000:0.0:1788863516.169981:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.170062:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b10389c going to sleep for 11 seconds 00000100:00100000:1.0:1788863516.174005:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226428928 00000100:00100000:1.0:1788863516.174027:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226428928 00000100:00100000:1.0:1788863516.174124:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788863516.174134:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000738152d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226428928:12345-0@lo:503: 00000100:00100000:1.0:1788863516.174337:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000738152d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226428928:12345-0@lo:503: Request processed in 203us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.174347:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863516.174638:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226428928:0@lo:503: 00000040:00080000:0.0:1788863516.175392:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863516.176013:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226429056:0@lo:502: 00000100:00100000:0.0:1788863516.176114:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.176168:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b10389c going to sleep for 11 seconds 00000100:00100000:3.0:1788863516.176245:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429056 00000100:00100000:3.0:1788863516.176272:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429056 00000100:00100000:3.0:1788863516.176356:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863516.176365:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000001ac9db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226429056:12345-0@lo:502: 00000100:00100000:3.0:1788863516.176585:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000001ac9db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226429056:12345-0@lo:502: Request processed in 220us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863516.176600:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788863516.177235:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226429056:0@lo:502: 00000040:00080000:0.0:1788863516.177894:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788863516.177934:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788863516.177947:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788863516.177957:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788863516.177967:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788863516.177978:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788863516.177988:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788863516.177998:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788863516.178008:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788863516.178018:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788863516.178028:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788863516.178038:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788863516.178048:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788863516.178058:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788863516.178068:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788863516.178121:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788863516.178133:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788863516.178145:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788863516.178158:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788863516.178171:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788863516.178182:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788863516.178192:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788863516.178203:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788863516.178214:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788863516.178224:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788863516.178234:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788863516.178244:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788863516.178264:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788863516.178303:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226429184:0@lo:502: 00000100:00100000:0.0:1788863516.178376:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.178417:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b10389c going to sleep for 11 seconds 00000100:00100000:1.0:1788863516.179788:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429184 00000100:00100000:1.0:1788863516.179804:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429184 00000100:00100000:1.0:1788863516.179885:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788863516.179895:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2e21ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226429184:12345-0@lo:502: 00000100:00100000:1.0:1788863516.180207:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2e21ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226429184:12345-0@lo:502: Request processed in 313us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.180216:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863516.180586:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226429184:0@lo:502: 00000040:00080000:0.0:1788863516.180689:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788863516.180715:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788863516.184241:0:7484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788863516.184280:0:7484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000003615e286) 00000020:00000080:2.0:1788863516.184316:0:7484:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788863516.184508:0:7484:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e6b0f2cc from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788863516.184516:0:7484:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e6b0f2cc from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788863516.184521:0:7484:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e6b0f2cc 3 00010000:00080000:2.0:1788863516.184576:0:7484:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009e7b292c@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863516.186936:0:7484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788863516.194176:0:7484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788863516.194247:0:7484:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863516.194296:0:7484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf569beb9d4b689e2 00000100:00080000:2.0:1788863516.194312:0:7484:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863516.194326:0:7484:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009e7b292c using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863516.194381:0:7484:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eac48aa2 x1875759226429312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863516.194411:0:7484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788863516.195052:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eac48aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226429312:0@lo:38: 00000100:00100000:1.0:1788863516.195176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863516.199361:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429312 00000100:00100000:2.0:1788863516.199381:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429312 00000100:00100000:2.0:1788863516.199458:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863516.199467:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000052fa67ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226429312:12345-0@lo:38: 00010000:00080000:2.0:1788863516.199512:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1788863516.199598:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf569beb9d4b689e9 00000004:00100000:2.0:1788863516.199621:0:6537:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788863516.199665:0:6537:0:(import.c:65:import_set_state_nolock()) 0000000056830672 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863516.199773:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000052fa67ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875759226429312:12345-0@lo:38: Request processed in 307us (4598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863516.199781:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788863516.199862:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eac48aa2 x1875759226429312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863516.199881:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863516.199908:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788863516.199918:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788863516.199924:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788863516.199928:0:3639:0:(import.c:65:import_set_state_nolock()) 000000009e7b292c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788863516.199936:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eac48aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226429312:0@lo:38: 00000040:00080000:2.0:1788863516.199940:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1788863516.200040:0:7485:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1788863516.200130:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788863516.200227:0:7466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788863516.200316:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000083b75811/0xf569beb9d4b689cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.200328:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000083b75811/0xf569beb9d4b689cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788863516.200397:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788863516.200401:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788863516.200403:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863516.200404:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863516.200407:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863516.200409:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863516.200411:0:7466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863516.200413:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788863516.200414:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788863516.200416:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863516.200417:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788863516.200422:0:7466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788863516.200425:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788863516.200427:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788863516.200429:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863516.200431:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863516.200433:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863516.200435:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863516.200436:0:7466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863516.200437:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788863516.200439:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788863516.200440:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863516.200441:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788863516.200470:0:7466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788863516.200497:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d157fa4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226429440:0@lo:253: 00000100:00100000:3.0:1788863516.200574:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863516.200622:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429440 00000100:00100000:3.0:1788863516.200631:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429440 00000100:00100000:3.0:1788863516.200675:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863516.200683:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eb986c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226429440:12345-0@lo:253: 20000000:01000000:3.0:1788863516.200710:0:6530:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788863516.200738:0:6530:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788863516.200895:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052cc23e1 going to sleep for 11 seconds 00000001:00100000:3.0:1788863516.210067:0:6516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788863516.210134:0:6530:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788863516.210275:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788863516.210567:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788863516.210575:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788863516.210599:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.210617:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.210624:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.210630:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.210669:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.210684:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 15 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863516.210697:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eb986c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7466:x1875759226429440:12345-0@lo:253: Request processed in 10015us (10124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863516.210698:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d152d31c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226429568:0@lo:104: 00000100:00100000:2.0:1788863516.210708:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863516.210752:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863516.210804:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.210813:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 14 pid: 6532 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863516.210824:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226429696:0@lo:104: 00000100:00100000:1.0:1788863516.210825:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429568 00000100:00100000:1.0:1788863516.210836:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429568 00000100:00100000:3.0:1788863516.210857:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863516.210882:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429696 00000100:00100000:1.0:1788863516.210886:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429696 00000100:00100000:3.0:1788863516.210887:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b8ee5b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788863516.210911:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863516.210922:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000041ee4303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6552:x1875759226429568:12345-0@lo:104: 00000100:00100000:3.0:1788863516.210925:0:6521:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788863516.210935:0:6521:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788863516.210936:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863516.211004:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863516.211011:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000041ee4303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6552:x1875759226429568:12345-0@lo:104: Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.211018:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863516.211026:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d152d31c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226429568:0@lo:104: 00010000:00010000:3.0:1788863516.211042:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788863516.211046:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788863516.211049:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211059:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a7b9ef28 already unused, calling callback (000000002e9b2fc7) 00000100:00100000:1.0:1788863516.211059:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004dcdf359 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226429696:12345-0@lo:104: 10000000:00010000:3.0:1788863516.211065:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863516.211070:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211105:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863516.211116:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863516.211123:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863516.211158:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788863516.211160:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863516.211165:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004dcdf359 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226429696:12345-0@lo:104: Request processed in 110us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.211176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788863516.211193:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863516.211217:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211224:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 00000000a7b9ef28/0xf569beb9d4b689aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689b1 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863516.211236:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d157fa4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7466:1875759226429440:0@lo:253: 00010000:00010000:3.0:1788863516.211240:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863516.211244:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211251:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e178d3e already unused, calling callback (000000002e9b2fc7) 10000000:01000000:1.0:1788863516.211252:0:7466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788863516.211269:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863516.211271:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788863516.211273:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863516.211275:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863516.211276:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863516.211278:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863516.211280:0:7466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863516.211282:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863516.211283:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863516.211285:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863516.211287:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788863516.211304:0:7466:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 10000000:00010000:3.0:1788863516.211340:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211351:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863516.211356:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863516.211361:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863516.211465:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211473:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863516.211568:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211574:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 000000004e178d3e/0xf569beb9d4b68909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211594:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863516.211595:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863516.211597:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863516.211603:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863516.211614:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ba2cdf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226429824:0@lo:103: 00000100:00100000:3.0:1788863516.211645:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863516.211681:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863516.211688:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033eabb6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226429952:0@lo:103: 00000100:00100000:3.0:1788863516.211710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863516.211734:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429824 00000100:00100000:3.0:1788863516.211738:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429824 00010000:00010000:3.0:1788863516.211755:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 15 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863516.211773:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226429952 00000100:00100000:3.0:1788863516.211776:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226429952 00010000:00010000:3.0:1788863516.211785:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 16 pid: 6532 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863516.211797:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863516.211803:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000141f934f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:3641:x1875759226429824:12345-0@lo:103: 00010000:00010000:3.0:1788863516.211813:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863516.211817:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 16 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211827:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 16 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211849:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089200dca/0xf569beb9d4b689b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b689aa expref: 16 pid: 6530 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211861:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863516.211896:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000141f934f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3641:x1875759226429824:12345-0@lo:103: Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863516.211902:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863516.211918:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863516.211927:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a9e8d652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:3643:x1875759226429952:12345-0@lo:103: 00010000:00010000:3.0:1788863516.211938:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863516.211942:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 14 pid: 6532 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211950:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 14 pid: 6532 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211965:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211973:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788863516.211987:0:6524:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007510891s 00010000:00010000:3.0:1788863516.211991:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.211998:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212005:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212018:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212025:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000050169c77 already unused, calling callback (0000000050850020) 00010000:00010000:3.0:1788863516.212030:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212039:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212049:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212066:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863516.212120:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a9e8d652 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:3643:x1875759226429952:12345-0@lo:103: Request processed in 196us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863516.212130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863516.212136:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ba2cdf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226429824:0@lo:103: 00000100:00100000:3.0:1788863516.212224:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033eabb6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226429952:0@lo:103: 00010000:00010000:3.0:1788863516.212362:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b97c193/0xf569beb9d4b68910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68909 expref: 13 pid: 6532 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863516.212414:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226429696:0@lo:104: 00010000:00010000:3.0:1788863516.212434:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212443:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212449:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863516.212465:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000050169c77/0xf569beb9d4b689f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788863516.227676:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788863516.228753:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788863516.232357:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788863516.233622:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788863516.235749:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788863516.237476:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788863516.239678:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788863516.240382:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788863516.240726:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788863516.242035:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788863516.242353:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788863516.242757:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788863516.245123:0:7466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788863516.245643:0:7491:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788863516.245707:0:7491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7491:1875759226430080:0@lo:700: 00000100:00100000:3.0:1788863516.245932:0:7491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863516.245979:0:7491:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e385e028 going to sleep for 11 seconds 00000040:01000000:2.0:1788863516.246039:0:7466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788863516.246577:0:6543:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226430080 00000100:00100000:1.0:1788863516.246586:0:6543:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226430080 00000100:00100000:1.0:1788863516.246625:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863516.246631:0:6543:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d152d31c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7491:x1875759226430080:12345-0@lo:700: 00000020:00080000:0.0:1788863516.246842:0:7490:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788863516.246847:0:7490:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788863516.247162:0:7492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430208:0@lo:1000: 00000100:00100000:2.0:1788863516.247215:0:7492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863516.247312:0:7492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053faa032 going to sleep for 11 seconds 00000040:01000000:3.0:1788863516.248509:0:7466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788863516.248621:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863516.249465:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226430208 00000100:00100000:0.0:1788863516.249476:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226430208 00000004:00000080:3.0:1788863516.249640:0:7466:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788863516.249650:0:7466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788863516.249845:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863516.250372:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863516.250382:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c6100864 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430208:12345-0@lo:1000: 00000100:00100000:1.0:1788863516.250531:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c6100864 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430208:12345-0@lo:1000: Request processed in 150us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.250548:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788863516.251655:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788863516.252335:0:7492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430208:0@lo:1000: 00000040:01000000:0.0:1788863516.252395:0:7492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788863516.252445:0:7492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430336:0@lo:700: 00000100:00100000:0.0:1788863516.252504:0:7492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.252546:0:7492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dacd5ed5 going to sleep for 11 seconds 00000100:00100000:1.0:1788863516.252662:0:6545:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226430336 00000100:00100000:1.0:1788863516.252671:0:6545:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226430336 00000100:00100000:1.0:1788863516.252725:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863516.252734:0:6545:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000356e2a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430336:12345-0@lo:700: 00000100:00100000:1.0:1788863516.252815:0:6545:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000356e2a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430336:12345-0@lo:700: Request processed in 82us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.252821:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863516.252851:0:7492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430336:0@lo:700: 00000100:00100000:1.0:1788863516.252897:0:7492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7492:1875759226430464:0@lo:900: 00000100:00100000:1.0:1788863516.252922:0:7492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863516.252947:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226430464 00000100:00100000:1.0:1788863516.252951:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226430464 00000100:00100000:1.0:1788863516.252980:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863516.252986:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d3b4e893 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7492:x1875759226430464:12345-0@lo:900: 00000100:00100000:1.0:1788863516.253018:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d3b4e893 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7492:x1875759226430464:12345-0@lo:900: Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.253023:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863516.253038:0:7492:0:(client.c:2716:ptlrpc_set_wait()) set 000000008caeff7c going to sleep for 11 seconds 00010000:00080000:1.0:1788863516.253051:0:7492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000da356484 x1875759226430464/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788863532 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863516.253062:0:7492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7492:1875759226430464:0@lo:900: 00000100:00100000:1.0:1788863516.253188:0:7492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430592:0@lo:1000: 00000100:00100000:1.0:1788863516.253229:0:7492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863516.253250:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226430592 00000100:00100000:1.0:1788863516.253273:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226430592 00000100:00100000:1.0:1788863516.253298:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863516.253303:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002ac413e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430592:12345-0@lo:1000: 00000100:00100000:1.0:1788863516.253356:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002ac413e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430592:12345-0@lo:1000: Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.253362:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863516.253380:0:7492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d50ec5ba going to sleep for 11 seconds 00000100:00100000:1.0:1788863516.253406:0:7492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430592:0@lo:1000: 00000004:00080000:1.0:1788863516.253452:0:7492:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008caeff7c with version 0 00000020:00100000:1.0:1788863516.253465:0:7492:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788863516.253470:0:7492:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000da356484 x1875759226430848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863516.253481:0:7492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430848:0@lo:1000: 00000100:00100000:1.0:1788863516.253500:0:7492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863516.253516:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226430848 00000100:00100000:1.0:1788863516.253519:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226430848 00000100:00100000:1.0:1788863516.253538:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863516.253543:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000047b30f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430848:12345-0@lo:1000: 00000100:00100000:1.0:1788863516.253885:0:7492:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b482d4d going to sleep for 11 seconds 00000040:00080000:3.0:1788863516.255071:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788863516.255268:0:7466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788863516.255568:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788863516.257404:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788863516.258198:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788863516.258361:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788863516.258490:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788863516.258658:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788863516.258836:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788863516.259038:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788863516.259202:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788863516.259368:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788863516.259911:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788863516.260035:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788863516.260413:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788863516.260561:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788863516.260738:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788863516.261117:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788863516.261339:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788863516.261548:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788863516.262301:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788863516.262597:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788863516.262734:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788863516.263344:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788863516.263583:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788863516.263718:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788863516.264007:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788863516.264451:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788863516.264603:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788863516.264732:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788863516.264930:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788863516.265130:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788863516.265280:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788863516.265403:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788863516.265535:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788863516.265689:0:7466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788863516.265922:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788863516.277160:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:0.0:1788863516.277297:0:6543:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1788863516.277353:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000047b30f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430848:12345-0@lo:1000: Request processed in 23795us (23837us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788863516.277367:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788863516.279580:0:7492:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788863516.279591:0:7492:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788863516.279613:0:7492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430848:0@lo:1000: 00000100:00100000:1.0:1788863516.281683:0:7492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430976:0@lo:1000: 00000100:00100000:1.0:1788863516.281767:0:7492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863516.281987:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226430976 00000100:00100000:1.0:1788863516.281995:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226430976 00000100:00100000:1.0:1788863516.282053:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863516.282062:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000035e50e99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430976:12345-0@lo:1000: 00000100:00100000:1.0:1788863516.282170:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000035e50e99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7492:x1875759226430976:12345-0@lo:1000: Request processed in 108us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863516.282179:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863516.282219:0:7492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb042a23 going to sleep for 11 seconds 00000100:00100000:1.0:1788863516.282244:0:7492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7492:1875759226430976:0@lo:1000: 00000040:00080000:1.0:1788863516.283020:0:7492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788863516.283064:0:7492:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006b482d4d with version 1 00000004:00080000:0.0:1788863516.285788:0:7480:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000754e12b9 version 1 rpc_version 1 00000020:00100000:0.0:1788863516.285830:0:7480:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788863516.285840:0:7480:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005fe75b41 x1875759226431232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863516.285867:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fe75b41 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1875759226431232:0@lo:1000: 00000100:00100000:0.0:1788863516.285930:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863516.285966:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e1b0482 going to sleep for 11 seconds 00000100:00100000:0.0:1788863516.286015:0:6543:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d152d31c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7491:x1875759226430080:12345-0@lo:700: Request processed in 39383us (40083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863516.286029:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788863516.286508:0:7491:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001e6b1ead x1875759226430080/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788863532 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863516.286548:0:7491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7491:1875759226430080:0@lo:700: 40000000:02000000:3.0:1788863516.286561:0:7491:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:1.0:1788863516.291639:0:7492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788863516.291747:0:7492:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788863516.292168:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226431232 00000100:00100000:1.0:1788863516.292183:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226431232 00000100:00100000:1.0:1788863516.292235:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863516.292244:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c91f96c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875759226431232:12345-0@lo:1000: 00000001:00080000:0.0:1788863516.294811:0:7466:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788863516.294858:0:7466:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa4a9c1ddb988 00100000:10000000:0.0:1788863516.294866:0:7466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788863516.299538:0:7466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788863516.299582:0:7466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788863516.299603:0:7466:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788863516.299626:0:7466:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788863516.300468:0:7466:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863516.300669:0:7466:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:1.0:1788863516.323965:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788863516.325124:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c91f96c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875759226431232:12345-0@lo:1000: Request processed in 32875us (39189us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788863516.325142:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788863516.327579:0:7480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788863516.327589:0:7480:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788863516.327622:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fe75b41 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1875759226431232:0@lo:1000: 00000040:00080000:3.0:1788863516.343801:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863516.359003:0:7491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788863516.359179:0:7491:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788863516.359186:0:7491:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788863516.847512:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863517.881591:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863518.892336:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863519.915388:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788863520.643349:0:7736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788863520.961624:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788863521.259954:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788863521.259964:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e648f4b800 from 4 10000000:01000000:3.0:1788863521.259970:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788863521.260024:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b689f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.260038:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b689f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.260064:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b689f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863521.260126:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226431360:0@lo:101: 00000100:00100000:3.0:1788863521.260216:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.260285:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014f90abc going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.260430:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226431360 00000100:00100000:1.0:1788863521.260440:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226431360 00000100:00100000:1.0:1788863521.260500:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788863521.260509:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e3c87cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:6534:x1875759226431360:12345-0@lo:101: 00010000:00010000:1.0:1788863521.260524:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863521.260540:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b689fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b689f7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.260583:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b689fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.260593:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069bc3f3c/0xf569beb9d4b689fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.260602:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069bc3f3c, rc 0) 00000100:00100000:1.0:1788863521.260643:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e3c87cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:6534:x1875759226431360:12345-0@lo:101: Request processed in 135us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.260650:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863521.262464:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226431360:0@lo:101: 00010000:00010000:3.0:1788863521.262492:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b689f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.262502:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b689f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863521.262591:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226431488:0@lo:256: 00000100:00100000:3.0:1788863521.262647:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.262690:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014f90abc going to sleep for 11 seconds 00000100:00100000:2.0:1788863521.262817:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226431488 00000100:00100000:2.0:1788863521.262825:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226431488 00000100:00100000:2.0:1788863521.262863:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863521.262870:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cd20f037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:6534:x1875759226431488:12345-0@lo:256: 20000000:01000000:2.0:1788863521.262888:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788863521.262904:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788863521.262906:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788863521.262982:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cd20f037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:6534:x1875759226431488:12345-0@lo:256: Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863521.262989:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863521.263023:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e6b1ead pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226431488:0@lo:256: 00000100:00100000:1.0:1788863521.264247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226431616:0@lo:41: 00000100:00100000:1.0:1788863521.264299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788863521.264507:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863521.264519:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b689f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863521.264530:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000050169c77/0xf569beb9d4b689f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863521.264540:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788863521.264542:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e64a89a800 from 21 10000000:01000000:2.0:1788863521.264545:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788863521.264570:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000a0b557b8/0xf569beb9d4b68a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863521.264578:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000a0b557b8/0xf569beb9d4b68a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863521.264601:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000a0b557b8/0xf569beb9d4b68a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863521.264617:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000358ab13b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226431744:0@lo:101: 00000100:00100000:2.0:1788863521.264645:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863521.264670:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b209cfb2 going to sleep for 11 seconds 00000100:00100000:2.0:1788863521.264690:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226431616 00000100:00100000:2.0:1788863521.264696:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226431616 00000100:00100000:1.0:1788863521.265144:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226431744 00000100:00100000:1.0:1788863521.265149:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226431744 00000100:00100000:1.0:1788863521.265195:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788863521.265202:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000057e01f75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:6534:x1875759226431744:12345-0@lo:101: 00010000:00010000:1.0:1788863521.265214:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863521.265226:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007084655d/0xf569beb9d4b68a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68a05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.265260:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007084655d/0xf569beb9d4b68a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.265270:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007084655d/0xf569beb9d4b68a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.265278:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007084655d, rc 0) 00000100:00100000:1.0:1788863521.265314:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000057e01f75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226431744:12345-0@lo:101: Request processed in 113us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.265327:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788863521.266413:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863521.266425:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000373d9da9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226431616:12345-0@lo:41: 00000004:00000024:2.0:1788863521.266461:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788863521.266518:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000373d9da9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226431616:12345-0@lo:41: Request processed in 97us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863521.266524:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863521.267263:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226431872:0@lo:400: 00000100:00100000:1.0:1788863521.267304:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.267334:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863521.267340:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226432000:0@lo:400: 00000100:00100000:1.0:1788863521.267363:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.267390:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226431872 00000100:00100000:1.0:1788863521.267397:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226431872 00000100:00100000:1.0:1788863521.267428:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432000 00000100:00100000:1.0:1788863521.267431:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432000 00000100:00100000:1.0:1788863521.267447:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863521.267452:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000584a4794 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226431872:12345-0@lo:400: 00000100:00100000:1.0:1788863521.267489:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000584a4794 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226431872:12345-0@lo:400: Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.267494:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863521.267508:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863521.267513:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003890c9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226432000:12345-0@lo:400: 00000100:00100000:1.0:1788863521.267536:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003890c9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226432000:12345-0@lo:400: Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.267541:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788863521.267569:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000936ece1 x1875759226432000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863521.267583:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226432000:0@lo:400: 00010000:00080000:1.0:1788863521.267591:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009ae94cb6 x1875759226431872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863521.267598:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226431872:0@lo:400: 00000100:00100000:3.0:1788863521.267995:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000358ab13b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226431744:0@lo:101: 00010000:00010000:3.0:1788863521.268016:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000a0b557b8/0xf569beb9d4b68a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.268027:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000a0b557b8/0xf569beb9d4b68a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863521.268425:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da356484 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226431616:0@lo:41: 00000100:00100000:3.0:1788863521.268871:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033eabb6f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432128:0@lo:501: 00000100:00100000:3.0:1788863521.268917:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.268960:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b10d1a36 going to sleep for 11 seconds 00000100:00100000:2.0:1788863521.270902:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432128 00000100:00100000:2.0:1788863521.270918:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432128 00000100:00100000:2.0:1788863521.270979:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788863521.270987:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000029dd115d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226432128:12345-0@lo:501: 00000100:00100000:2.0:1788863521.272778:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000029dd115d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226432128:12345-0@lo:501: Request processed in 1785us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863521.272794:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863521.274003:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033eabb6f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432128:0@lo:501: 00000100:00100000:0.0:1788863521.274100:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432256:0@lo:503: 00000100:00100000:0.0:1788863521.274193:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863521.274238:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2f8088a going to sleep for 11 seconds 00000100:00100000:0.0:1788863521.274260:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432256 00000100:00100000:0.0:1788863521.274267:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432256 00000100:00100000:0.0:1788863521.274317:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788863521.274326:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a11034b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226432256:12345-0@lo:503: 00000100:00100000:0.0:1788863521.274440:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a11034b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226432256:12345-0@lo:503: Request processed in 115us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863521.274447:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788863521.274496:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432256:0@lo:503: 00000100:00100000:0.0:1788863521.274685:0:7758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7758:1875759226432384:0@lo:502: 00000100:00100000:0.0:1788863521.276642:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863521.276751:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2f8088a going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.282090:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432384 00000100:00100000:1.0:1788863521.282113:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432384 00000100:00100000:1.0:1788863521.282205:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863521.282215:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006db365cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7758:x1875759226432384:12345-0@lo:502: 00000100:00100000:1.0:1788863521.282412:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006db365cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7758:x1875759226432384:12345-0@lo:502: Request processed in 198us (5776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.282421:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788863521.289695:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7758:1875759226432384:0@lo:502: 00000100:00100000:0.0:1788863521.289883:0:7758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7758:1875759226432512:0@lo:502: 00000100:00100000:0.0:1788863521.289971:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863521.290027:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094a2cb10 going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.290972:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432512 00000100:00100000:1.0:1788863521.290983:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432512 00000100:00100000:1.0:1788863521.291040:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788863521.291061:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008203685c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7758:x1875759226432512:12345-0@lo:502: 00000100:00100000:1.0:1788863521.291250:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008203685c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:7758:x1875759226432512:12345-0@lo:502: Request processed in 191us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.291260:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788863521.292249:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7758:1875759226432512:0@lo:502: 00000040:00080000:0.0:1788863521.292295:0:7758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788863521.294819:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788863521.294859:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788863521.294870:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000a0b557b8/0xf569beb9d4b68a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.294882:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000a0b557b8/0xf569beb9d4b68a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863521.294892:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788863521.294894:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e64a89a800 from 4 10000000:01000000:1.0:1788863521.294897:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788863521.294938:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b68a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.294945:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b68a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.294965:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b68a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863521.294990:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432640:0@lo:101: 00000100:00100000:1.0:1788863521.295098:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.295146:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f50644e7 going to sleep for 11 seconds 00000100:00100000:3.0:1788863521.295835:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432640 00000100:00100000:3.0:1788863521.295846:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432640 00000100:00100000:3.0:1788863521.295898:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863521.295906:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008b210146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226432640:12345-0@lo:101: 00010000:00010000:3.0:1788863521.295921:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863521.295935:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b68a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68a13 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.295960:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b68a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.295971:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7b9ef28/0xf569beb9d4b68a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.295990:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7b9ef28, rc 0) 00000100:00100000:3.0:1788863521.296055:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008b210146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226432640:12345-0@lo:101: Request processed in 149us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863521.296062:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863521.296133:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ae94cb6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432640:0@lo:101: 00010000:00010000:3.0:1788863521.296149:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b68a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.296168:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b68a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863521.296227:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4c9628c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432768:0@lo:256: 00000100:00100000:3.0:1788863521.296262:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.296290:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a595141e going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.298862:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432768 00000100:00100000:1.0:1788863521.298879:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432768 00000100:00100000:1.0:1788863521.298938:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788863521.298947:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002d0bec06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226432768:12345-0@lo:256: 20000000:01000000:1.0:1788863521.298977:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788863521.298994:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788863521.298996:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788863521.299183:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002d0bec06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226432768:12345-0@lo:256: Request processed in 237us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.299192:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863521.300070:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4c9628c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432768:0@lo:256: 10000000:01000000:3.0:1788863521.300188:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788863521.300200:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b68a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.300213:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000dee1b91e/0xf569beb9d4b68a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863521.300224:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788863521.300226:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788863521.300229:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788863521.300260:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000006aad1ee1/0xf569beb9d4b68a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.300279:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000006aad1ee1/0xf569beb9d4b68a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.300290:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000006aad1ee1/0xf569beb9d4b68a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863521.300313:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4c9628c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432896:0@lo:101: 00000100:00100000:3.0:1788863521.300361:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.300398:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a595141e going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.302883:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226432896 00000100:00100000:1.0:1788863521.302899:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226432896 00000100:00100000:1.0:1788863521.302961:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788863521.302971:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004cd1d04a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226432896:12345-0@lo:101: 00010000:00010000:1.0:1788863521.302991:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863521.303010:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4e7abeb/0xf569beb9d4b68a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68a21 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.303040:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4e7abeb/0xf569beb9d4b68a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.303065:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4e7abeb/0xf569beb9d4b68a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.303113:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4e7abeb, rc 0) 00000100:00100000:1.0:1788863521.303207:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004cd1d04a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226432896:12345-0@lo:101: Request processed in 238us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.303214:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788863521.303277:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4c9628c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226432896:0@lo:101: 00010000:00010000:1.0:1788863521.303296:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000006aad1ee1/0xf569beb9d4b68a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863521.303306:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000006aad1ee1/0xf569beb9d4b68a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863521.303386:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433024:0@lo:501: 00000100:00100000:1.0:1788863521.303417:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.303450:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000778c6868 going to sleep for 11 seconds 00000100:00100000:3.0:1788863521.303603:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433024 00000100:00100000:3.0:1788863521.303608:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433024 00000100:00100000:3.0:1788863521.303646:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863521.303653:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000498718ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226433024:12345-0@lo:501: 00000100:00100000:3.0:1788863521.303783:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000498718ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226433024:12345-0@lo:501: Request processed in 131us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863521.303790:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788863521.304149:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433024:0@lo:501: 00000100:00100000:1.0:1788863521.304193:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433152:0@lo:503: 00000100:00100000:1.0:1788863521.304237:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.304258:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000778c6868 going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.304271:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433152 00000100:00100000:1.0:1788863521.304275:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433152 00000100:00100000:1.0:1788863521.304299:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788863521.304305:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bafa5f32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226433152:12345-0@lo:503: 00000100:00100000:1.0:1788863521.304388:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bafa5f32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226433152:12345-0@lo:503: Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.304394:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788863521.304439:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433152:0@lo:503: 00000100:00100000:1.0:1788863521.304634:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7760:1875759226433280:0@lo:502: 00000100:00100000:1.0:1788863521.304672:0:7760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.304697:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set 00000000778c6868 going to sleep for 11 seconds 00000100:00100000:3.0:1788863521.305099:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433280 00000100:00100000:3.0:1788863521.305105:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433280 00000100:00100000:3.0:1788863521.305128:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863521.305134:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000059319eec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:7760:x1875759226433280:12345-0@lo:502: 00000100:00100000:3.0:1788863521.305247:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000059319eec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:7760:x1875759226433280:12345-0@lo:502: Request processed in 112us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863521.305254:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788863521.307230:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7760:1875759226433280:0@lo:502: 00000020:01000000:1.0:1788863521.307288:0:7760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863521.307303:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863521.307305:0:7760:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788863521.307310:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788863521.307315:0:7760:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:1.0:1788863521.307343:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863521.307373:0:7760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000003485edc0) 00000020:00000080:1.0:1788863521.307398:0:7760:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788863521.307405:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788863521.307500:0:7760:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788863521.307507:0:7760:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788863521.307517:0:7760:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b68a36 00010000:00080000:1.0:1788863521.307552:0:7760:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d113d9e6@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788863521.316456:0:7760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788863521.318021:0:7760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788863521.318037:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788863521.318328:0:7760:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788863521.318352:0:7760:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b68a3d 00000100:00080000:1.0:1788863521.318364:0:7760:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863521.318376:0:7760:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d113d9e6 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863521.318415:0:7760:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000936ece1 x1875759226433408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863521.318472:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226433408:0@lo:38: 00000100:00100000:2.0:1788863521.318547:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.318643:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433408 00000100:00100000:3.0:1788863521.318652:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433408 00000100:00100000:3.0:1788863521.318694:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863521.318702:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073de7186 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226433408:12345-0@lo:38: 00010000:00080000:3.0:1788863521.318751:0:6541:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1788863521.318784:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b68a44 00000004:00100000:3.0:1788863521.318800:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788863521.318805:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788863521.318972:0:7760:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788863521.319032:0:7760:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1788863521.324636:0:7763:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000007fcabeab x1875759226433536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863521.324664:0:7763:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4c40b26 going to sleep for 0 seconds 00000020:01000000:0.0:1788863521.324985:0:7760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863521.324993:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863521.324995:0:7760:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788863521.325007:0:7760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863521.325013:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863521.325014:0:7760:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788863521.325017:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863521.325018:0:7760:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788863521.325055:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7760:1875759226433664:0@lo:502: 00000100:00100000:0.0:1788863521.325182:0:7760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863521.325234:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1513293 going to sleep for 11 seconds 00000100:00100000:2.0:1788863521.325239:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433664 00000100:00100000:2.0:1788863521.325253:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433664 00000100:00100000:2.0:1788863521.325309:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788863521.325318:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000431d6e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:7760:x1875759226433664:12345-0@lo:502: 00000100:00100000:2.0:1788863521.325536:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000431d6e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:7760:x1875759226433664:12345-0@lo:502: Request processed in 219us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863521.325544:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788863521.325765:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:7760:1875759226433664:0@lo:502: 00000020:01000000:0.0:1788863521.325794:0:7760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863521.325800:0:7760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863521.325801:0:7760:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788863521.325804:0:7760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788863521.327923:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788863521.327961:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788863521.327971:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000006aad1ee1/0xf569beb9d4b68a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863521.327984:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000006aad1ee1/0xf569beb9d4b68a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863521.327994:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788863521.327997:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89e671354d40 from 1 10000000:01000000:2.0:1788863521.328000:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788863521.328037:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000009b97c193/0xf569beb9d4b68a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863521.328055:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000009b97c193/0xf569beb9d4b68a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863521.328065:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000009b97c193/0xf569beb9d4b68a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863521.328116:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006919f268 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433792:0@lo:101: 00000100:00100000:2.0:1788863521.328195:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863521.328244:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e39d4a16 going to sleep for 11 seconds 00000100:00100000:0.0:1788863521.328906:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433792 00000100:00100000:0.0:1788863521.328917:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433792 00000100:00100000:0.0:1788863521.328977:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788863521.328986:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b38fd28d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226433792:12345-0@lo:101: 00010000:00010000:0.0:1788863521.329001:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863521.329014:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a00ddf11/0xf569beb9d4b68a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68a4b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863521.329039:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a00ddf11/0xf569beb9d4b68a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863521.329051:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a00ddf11/0xf569beb9d4b68a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863521.329059:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a00ddf11, rc 0) 00000100:00100000:0.0:1788863521.329138:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b38fd28d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226433792:12345-0@lo:101: Request processed in 154us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863521.329170:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788863521.329187:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006919f268 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433792:0@lo:101: 00010000:00010000:3.0:1788863521.329203:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000009b97c193/0xf569beb9d4b68a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863521.329211:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000009b97c193/0xf569beb9d4b68a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863521.329284:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086cfae81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433920:0@lo:501: 00000100:00100000:3.0:1788863521.329315:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.329339:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f9dabde going to sleep for 11 seconds 00000100:00100000:2.0:1788863521.329698:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433920 00000100:00100000:2.0:1788863521.329708:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433920 00000100:00100000:2.0:1788863521.329756:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788863521.329762:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000082d7074b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226433920:12345-0@lo:501: 00000100:00100000:2.0:1788863521.329836:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000082d7074b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226433920:12345-0@lo:501: Request processed in 75us (521us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863521.329843:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788863521.329874:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086cfae81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226433920:0@lo:501: 10000000:01000000:2.0:1788863521.329903:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788863521.329909:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000009b97c193/0xf569beb9d4b68a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863521.329916:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000009b97c193/0xf569beb9d4b68a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788863521.341997:0:6541:0:(import.c:65:import_set_state_nolock()) 00000000ddb88c2e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863521.342502:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073de7186 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226433408:12345-0@lo:38: Request processed in 23797us (23951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863521.342594:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863521.342682:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863521.342691:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788863521.342700:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788863521.342706:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788863521.342708:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000d113d9e6 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788863521.342852:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c4c40b26): req@000000007fcabeab x1875759226433536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863521.342877:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000936ece1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226433408:0@lo:38: 00000100:00100000:2.0:1788863521.342984:0:7763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863521.343012:0:7763:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4c40b26 going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.343065:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226433536 00000100:00100000:1.0:1788863521.343072:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226433536 00000100:00100000:1.0:1788863521.343209:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863521.343217:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006919f268 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226433536:12345-0@lo:1000: 00000100:00100000:1.0:1788863521.343296:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006919f268 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226433536:12345-0@lo:1000: Request processed in 79us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.343302:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863521.343333:0:7763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fcabeab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226433536:0@lo:1000: 00000040:01000000:1.0:1788863521.343367:0:7763:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788863521.343410:0:7763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fcabeab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434048:0@lo:1000: 00000100:00100000:2.0:1788863521.344510:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226434176:0@lo:41: 00000100:00100000:2.0:1788863521.344631:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.344722:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226434176 00000100:00100000:1.0:1788863521.344730:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226434176 00000100:00100000:1.0:1788863521.344770:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788863521.344777:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000358ab13b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226434176:12345-0@lo:41: 00000004:00000024:1.0:1788863521.344818:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788863521.346640:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000358ab13b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226434176:12345-0@lo:41: Request processed in 1855us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.346656:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788863521.346839:0:7763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863521.346916:0:7763:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1617725 going to sleep for 11 seconds 00000100:00100000:2.0:1788863521.347000:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022b6bcbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226434176:0@lo:41: 00000100:00100000:0.0:1788863521.347262:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226434048 00000100:00100000:0.0:1788863521.347270:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226434048 00000100:00100000:1.0:1788863521.347484:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863521.347496:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000936ece1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226434048:12345-0@lo:1000: 00000100:00100000:1.0:1788863521.347870:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000936ece1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226434048:12345-0@lo:1000: Request processed in 376us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863521.347879:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863521.348024:0:7763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fcabeab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434048:0@lo:1000: 00000100:00100000:2.0:1788863521.348126:0:7763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434304:0@lo:700: 00000100:00100000:2.0:1788863521.348169:0:7763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863521.348207:0:7763:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077399779 going to sleep for 11 seconds 00000100:00100000:0.0:1788863521.352620:0:6545:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226434304 00000100:00100000:0.0:1788863521.352640:0:6545:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226434304 00000100:00100000:0.0:1788863521.352719:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863521.352729:0:6545:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eac48aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226434304:12345-0@lo:700: 00000100:00100000:0.0:1788863521.352852:0:6545:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eac48aa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226434304:12345-0@lo:700: Request processed in 125us (4683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863521.352859:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863521.353356:0:7763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434304:0@lo:700: 00000100:00100000:2.0:1788863521.353570:0:7763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434432:0@lo:1000: 00000100:00100000:2.0:1788863521.353626:0:7763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863521.353653:0:7763:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a4e9af1 going to sleep for 11 seconds 00000100:00100000:0.0:1788863521.353836:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226434432 00000100:00100000:0.0:1788863521.353843:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226434432 00000100:00100000:0.0:1788863521.353873:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788863521.353879:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c995f96a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226434432:12345-0@lo:1000: 00000100:00100000:0.0:1788863521.353960:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c995f96a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226434432:12345-0@lo:1000: Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863521.353969:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863521.354403:0:7763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434432:0@lo:1000: 00000004:00080000:2.0:1788863521.354474:0:7763:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000077399779 with version 0 00000020:00100000:2.0:1788863521.354493:0:7763:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788863521.354500:0:7763:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004510a434 x1875759226434688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863521.354516:0:7763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434688:0@lo:1000: 00000100:00100000:2.0:1788863521.354543:0:7763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863521.354567:0:7763:0:(client.c:2716:ptlrpc_set_wait()) set 000000007aca8207 going to sleep for 11 seconds 00000100:00100000:0.0:1788863521.354616:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226434688 00000100:00100000:0.0:1788863521.354621:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226434688 00000100:00100000:0.0:1788863521.354641:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863521.354646:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005db088ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7763:x1875759226434688:12345-0@lo:1000: 00000001:00080000:0.0:1788863521.359178:0:7467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788863521.359194:0:7467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788863521.359446:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005db088ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7763:x1875759226434688:12345-0@lo:1000: Request processed in 4795us (4898us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788863521.359472:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1788863521.363560:0:7763:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788863521.363572:0:7763:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788863521.363593:0:7763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004510a434 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434688:0@lo:1000: 00000100:00100000:3.0:1788863521.363705:0:7763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000141f934f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434816:0@lo:1000: 00000100:00100000:3.0:1788863521.364602:0:7763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863521.365862:0:7763:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044183eec going to sleep for 11 seconds 00000100:00100000:1.0:1788863521.367279:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226434816 00000100:00100000:1.0:1788863521.367298:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226434816 00000100:00100000:0.0:1788863521.369877:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863521.369890:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000089057898 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7763:x1875759226434816:12345-0@lo:1000: 00000100:00100000:0.0:1788863521.370034:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000089057898 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7763:x1875759226434816:12345-0@lo:1000: Request processed in 146us (5434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863521.370056:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863521.374675:0:7763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000141f934f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7763:1875759226434816:0@lo:1000: 00000040:00080000:2.0:1788863521.374743:0:7763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788863521.374800:0:7763:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000052cb99c6 with version 1 00000004:00080000:0.0:1788863521.375612:0:7761:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000778c6868 version 1 rpc_version 1 00000020:00100000:0.0:1788863521.375655:0:7761:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788863521.375663:0:7761:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000597d421e x1875759226435072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863521.375685:0:7761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000597d421e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7761:1875759226435072:0@lo:1000: 00000100:00100000:0.0:1788863521.375763:0:7761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863521.375818:0:7761:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c03e5bfd going to sleep for 11 seconds 00000100:00100000:0.0:1788863521.375861:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435072 00000100:00100000:0.0:1788863521.375870:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435072 00000100:00100000:0.0:1788863521.375940:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863521.375950:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000022b6bcbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7761:x1875759226435072:12345-0@lo:1000: 00000040:00080000:2.0:1788863521.381191:0:7763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788863521.382198:0:7763:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788863521.382205:0:7763:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788863521.391903:0:7467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788863521.392314:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000022b6bcbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7761:x1875759226435072:12345-0@lo:1000: Request processed in 16357us (16544us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788863521.392331:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788863521.395593:0:7761:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788863521.395605:0:7761:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788863521.395630:0:7761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000597d421e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7761:1875759226435072:0@lo:1000: 00000020:00000004:0.0:1788863521.813064:0:7793:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863521.814040:0:7793:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788863521.965288:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863522.987891:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863524.015817:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788863524.977899:0:7895:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788863524.978166:0:7895:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863525.036228:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863526.061379:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788863526.067903:0:7943:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4b9d2d50 20000000:00000080:2.0:1788863526.067925:0:7943:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e67aef3000 uarg=0000000000000000 20000000:01000000:2.0:1788863526.068048:0:7943:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788863526.068278:0:7943:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788863526.068283:0:7943:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788863526.068351:0:7943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788863526.068364:0:7943:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788863526.073408:0:7943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863526.073759:0:7943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788863526.073794:0:7943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788863526.073810:0:7943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788863526.073828:0:7943:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788863526.073849:0:7943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.073871:0:7943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.073878:0:7943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.073885:0:7943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.074428:0:7943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.074444:0:7943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 17 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863526.074460:0:7943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f381f710 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7943:1875759226435200:0@lo:104: 00000100:00100000:2.0:1788863526.074536:0:7943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863526.074610:0:7943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.074633:0:7943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 17 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863526.074641:0:7943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7943:1875759226435328:0@lo:104: 00000100:00100000:2.0:1788863526.074674:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f2a3ec9 going to sleep for 11 seconds 00000100:00100000:0.0:1788863526.074750:0:6521:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788863526.074770:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863526.074804:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435200 00000100:00100000:0.0:1788863526.074813:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435200 00000100:00100000:0.0:1788863526.074872:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435328 00000100:00100000:0.0:1788863526.074876:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435328 00000100:00100000:0.0:1788863526.074901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863526.074910:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ac5f3e5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:7943:x1875759226435200:12345-0@lo:104: 00010000:00010000:0.0:1788863526.074923:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.074988:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863526.075000:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ac5f3e5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:7943:x1875759226435200:12345-0@lo:104: Request processed in 91us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863526.075007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863526.075045:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863526.075051:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005fe75b41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:7943:x1875759226435328:12345-0@lo:104: 00010000:00010000:0.0:1788863526.075057:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075128:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788863526.075132:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005fe75b41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:7943:x1875759226435328:12345-0@lo:104: Request processed in 83us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863526.075138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788863526.075155:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863526.075161:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075168:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066495795 already unused, calling callback (000000002e9b2fc7) 10000000:00010000:0.0:1788863526.075171:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075179:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863526.075185:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863526.075190:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788863526.075219:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075236:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863526.075257:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075263:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 0000000066495795/0xf569beb9d4b689bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689c6 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075276:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863526.075279:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075284:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ada5163 already unused, calling callback (000000002e9b2fc7) 10000000:00010000:0.0:1788863526.075286:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075291:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863526.075296:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863526.075301:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788863526.075313:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075318:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863526.075331:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075336:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 000000008ada5163/0xf569beb9d4b688d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b688d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075355:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863526.075356:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863526.075358:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863526.075377:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226435456:0@lo:103: 00000100:00100000:0.0:1788863526.075410:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863526.075452:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863526.075459:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d7ff37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226435584:0@lo:103: 00000100:00100000:0.0:1788863526.075483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863526.075514:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435456 00000100:00100000:0.0:1788863526.075518:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435456 00010000:00010000:0.0:1788863526.075534:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 18 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863526.075555:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435584 00000100:00100000:0.0:1788863526.075558:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435584 00010000:00010000:0.0:1788863526.075568:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 19 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863526.075580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863526.075586:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000009d6cd68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:3643:x1875759226435456:12345-0@lo:103: 00010000:00010000:0.0:1788863526.075596:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863526.075601:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 19 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075609:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 19 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075624:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863526.075656:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000009d6cd68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:3643:x1875759226435456:12345-0@lo:103: Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863526.075662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863526.075674:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863526.075679:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000077d2907c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:3641:x1875759226435584:12345-0@lo:103: 00010000:00010000:0.0:1788863526.075686:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863526.075690:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 18 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075697:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 18 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075706:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075714:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075727:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075733:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075739:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075744:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075748:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020b083ed already unused, calling callback (0000000050850020) 00010000:00010000:0.0:1788863526.075757:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075764:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075772:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863526.075783:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863526.075809:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000077d2907c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:3641:x1875759226435584:12345-0@lo:103: Request processed in 130us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863526.075815:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863526.075856:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d7ff37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226435584:0@lo:103: 00000100:00100000:0.0:1788863526.075883:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226435456:0@lo:103: 00010000:00010000:2.0:1788863526.076007:0:7943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000001bbee2c/0xf569beb9d4b689c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b689bf expref: 17 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863526.076019:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f381f710 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7943:1875759226435200:0@lo:104: 00010000:00010000:2.0:1788863526.076027:0:7943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008353d384/0xf569beb9d4b688d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b688d1 expref: 16 pid: 6529 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863526.076034:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7943:1875759226435328:0@lo:104: 00010000:00010000:2.0:1788863526.076049:0:7943:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.076057:0:7943:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.076073:0:7943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863526.076094:0:7943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000020b083ed/0xf569beb9d4b68a59 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863526.077265:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863526.379379:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788863526.379408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226435840:0@lo:41: 00000100:00100000:1.0:1788863526.379488:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863526.379565:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003de5b1c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226435712:0@lo:41: 00000100:00100000:1.0:1788863526.379588:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863526.379628:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435840 00000100:00100000:0.0:1788863526.379637:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435840 00000100:00100000:0.0:1788863526.379677:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435712 00000100:00100000:0.0:1788863526.379680:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435712 00000100:00100000:0.0:1788863526.379698:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863526.379706:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000b92ec04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226435840:12345-0@lo:41: 00000004:00000024:0.0:1788863526.379745:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788863526.379797:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000b92ec04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226435840:12345-0@lo:41: Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863526.379803:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863526.379819:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863526.379824:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000418d18e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226435712:12345-0@lo:41: 00000100:00100000:3.0:1788863526.379825:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023ff958b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226435840:0@lo:41: 00000004:00000024:0.0:1788863526.379839:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788863526.379874:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000418d18e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226435712:12345-0@lo:41: Request processed in 50us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863526.379879:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863526.379887:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003de5b1c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226435712:0@lo:41: 00000100:00100000:0.0:1788863526.380273:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000287bdabc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226435968:0@lo:400: 00000100:00100000:0.0:1788863526.380307:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863526.380332:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863526.380338:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fcabeab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226436096:0@lo:400: 00000100:00100000:0.0:1788863526.380365:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863526.380480:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226435968 00000100:00100000:3.0:1788863526.380486:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226435968 00000100:00100000:3.0:1788863526.380524:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436096 00000100:00100000:3.0:1788863526.380527:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436096 00000100:00100000:3.0:1788863526.380542:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863526.380548:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000039d7ff37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226435968:12345-0@lo:400: 00000100:00100000:3.0:1788863526.380591:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000039d7ff37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226435968:12345-0@lo:400: Request processed in 44us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863526.380597:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863526.380610:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788863526.380615:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dca67f92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226436096:12345-0@lo:400: 00000100:00100000:3.0:1788863526.380650:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dca67f92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226436096:12345-0@lo:400: Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863526.380656:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788863526.380812:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007fcabeab x1875759226436096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863526.380825:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fcabeab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226436096:0@lo:400: 00010000:00080000:2.0:1788863526.380846:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000287bdabc x1875759226435968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863526.380854:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000287bdabc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226435968:0@lo:400: 00010000:00010000:0.0:1788863527.083582:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863528.108329:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863529.132356:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863530.158948:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788863530.987248:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863530.987261:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e648f4b800 from 1 10000000:01000000:0.0:1788863530.987268:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863530.987344:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000005fd866ef/0xf569beb9d4b68a60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863530.987570:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000005fd866ef/0xf569beb9d4b68a60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863530.987584:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000005fd866ef/0xf569beb9d4b68a60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863530.987617:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436224:0@lo:101: 00000100:00100000:0.0:1788863530.987712:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863530.987839:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c7cf64f going to sleep for 11 seconds 00000100:00100000:3.0:1788863530.990391:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436224 00000100:00100000:3.0:1788863530.990412:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436224 00000100:00100000:2.0:1788863530.990730:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788863530.990742:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d24c52dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226436224:12345-0@lo:101: 00010000:00010000:2.0:1788863530.990769:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863530.990795:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055aec0c3/0xf569beb9d4b68a67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68a60 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863530.990835:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055aec0c3/0xf569beb9d4b68a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863530.990848:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055aec0c3/0xf569beb9d4b68a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863530.990858:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055aec0c3, rc 0) 00000100:00100000:2.0:1788863530.991025:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d24c52dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226436224:12345-0@lo:101: Request processed in 285us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863530.991034:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788863530.991248:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dce3f8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436224:0@lo:101: 00010000:00010000:3.0:1788863530.991268:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000005fd866ef/0xf569beb9d4b68a60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863530.991278:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000005fd866ef/0xf569beb9d4b68a60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863530.991493:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436352:0@lo:501: 00000100:00100000:2.0:1788863530.991536:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863530.991613:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000001667c03c going to sleep for 11 seconds 00000100:00100000:3.0:1788863530.991644:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436352 00000100:00100000:3.0:1788863530.991650:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436352 00000100:00100000:3.0:1788863530.991689:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788863530.991696:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f74ee8fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226436352:12345-0@lo:501: 00000100:00100000:3.0:1788863530.991876:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f74ee8fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226436352:12345-0@lo:501: Request processed in 181us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863530.991884:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788863530.991994:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436352:0@lo:501: 00000100:00100000:2.0:1788863530.992030:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436480:0@lo:503: 00000100:00100000:2.0:1788863530.992141:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863530.992197:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000001667c03c going to sleep for 11 seconds 00000100:00100000:3.0:1788863530.992234:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436480 00000100:00100000:3.0:1788863530.992239:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436480 00000100:00100000:3.0:1788863530.992292:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788863530.992302:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c6bc8bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226436480:12345-0@lo:503: 00000100:00100000:3.0:1788863530.992411:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c6bc8bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226436480:12345-0@lo:503: Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863530.992418:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788863530.992453:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033040305 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436480:0@lo:503: 00000100:00100000:3.0:1788863530.992878:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038b0cdba pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8141:1875759226436608:0@lo:502: 00000100:00100000:3.0:1788863530.992914:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863530.993067:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053faa032 going to sleep for 11 seconds 00000100:00100000:1.0:1788863530.993378:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436608 00000100:00100000:1.0:1788863530.993390:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436608 00000100:00100000:1.0:1788863530.993460:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788863530.993467:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000056e34344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8141:x1875759226436608:12345-0@lo:502: 00000100:00100000:1.0:1788863530.993578:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000056e34344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8141:x1875759226436608:12345-0@lo:502: Request processed in 112us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863530.993586:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788863530.993621:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038b0cdba pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8141:1875759226436608:0@lo:502: 00000020:01000000:3.0:1788863530.993650:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863530.993663:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863530.993666:0:8141:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788863530.993673:0:8141:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e648f4b800 00000020:00000080:3.0:1788863530.993676:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863530.993735:0:8141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8141:1875759226436736:0@lo:502: 00000100:00100000:3.0:1788863530.993769:0:8141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863530.993810:0:8141:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863530.993963:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436736 00000100:00100000:2.0:1788863530.993977:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436736 00000100:00100000:2.0:1788863530.994012:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788863530.994020:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8141:x1875759226436736:12345-0@lo:502: 00000100:00100000:2.0:1788863530.994130:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8141:x1875759226436736:12345-0@lo:502: Request processed in 111us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863530.994137:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788863530.994158:0:8141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8141:1875759226436736:0@lo:502: 00000020:01000000:1.0:1788863530.994176:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863530.994181:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863530.994183:0:8141:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788863530.994193:0:8141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788863530.994403:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788863530.994433:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863530.994444:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863530.994455:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863530.994466:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788863530.994469:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e64a89a800 from 1 10000000:01000000:2.0:1788863530.994472:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863530.994787:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863530.994797:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863530.994808:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863530.994822:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436864:0@lo:101: 00000100:00100000:2.0:1788863530.994859:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863530.994894:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863530.995102:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436864 00000100:00100000:1.0:1788863530.995109:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436864 00000100:00100000:1.0:1788863530.995144:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788863530.995152:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226436864:12345-0@lo:101: 00010000:00010000:1.0:1788863530.995164:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863530.995179:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68a6e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863530.995208:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863530.995220:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863530.995230:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114600, rc 0) 00000100:00100000:1.0:1788863530.995281:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226436864:12345-0@lo:101: Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863530.995287:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788863530.995581:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436864:0@lo:101: 00010000:00010000:3.0:1788863530.995596:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863530.995606:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863530.995693:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436992:0@lo:501: 00000100:00100000:3.0:1788863530.995724:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863530.995762:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863530.996068:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226436992 00000100:00100000:1.0:1788863530.996097:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226436992 00000100:00100000:1.0:1788863530.996132:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788863530.996140:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226436992:12345-0@lo:501: 00000100:00100000:1.0:1788863530.996268:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226436992:12345-0@lo:501: Request processed in 128us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863530.996276:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788863530.996371:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226436992:0@lo:501: 00000100:00100000:3.0:1788863530.996404:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226437120:0@lo:503: 00000100:00100000:3.0:1788863530.996445:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863530.996469:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863530.996492:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226437120 00000100:00100000:3.0:1788863530.996495:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226437120 00000100:00100000:3.0:1788863530.996517:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788863530.996522:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226437120:12345-0@lo:503: 00000100:00100000:3.0:1788863530.996603:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226437120:12345-0@lo:503: Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863530.996610:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788863530.996648:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226437120:0@lo:503: 00000100:00100000:3.0:1788863530.996893:0:8142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8142:1875759226437248:0@lo:502: 00000100:00100000:3.0:1788863530.996924:0:8142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863530.996954:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226437248 00000100:00100000:3.0:1788863530.996959:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226437248 00000100:00100000:3.0:1788863530.996991:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788863530.996997:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8142:x1875759226437248:12345-0@lo:502: 00000100:00100000:3.0:1788863530.997062:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8142:x1875759226437248:12345-0@lo:502: Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863530.997069:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788863530.997128:0:8142:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863530.997141:0:8142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8142:1875759226437248:0@lo:502: 00000020:01000000:3.0:1788863530.997162:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863530.997174:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863530.997177:0:8142:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788863530.997184:0:8142:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e64a89a800 00000020:00000080:3.0:1788863530.997186:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863530.997207:0:8142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8142:1875759226437376:0@lo:502: 00000100:00100000:3.0:1788863530.997236:0:8142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863530.997255:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226437376 00000100:00100000:3.0:1788863530.997259:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226437376 00000100:00100000:3.0:1788863530.997279:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788863530.997286:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8142:x1875759226437376:12345-0@lo:502: 00000100:00100000:3.0:1788863530.997336:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8142:x1875759226437376:12345-0@lo:502: Request processed in 49us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863530.997342:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788863530.997371:0:8142:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863530.997382:0:8142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8142:1875759226437376:0@lo:502: 00000020:01000000:3.0:1788863530.997399:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863530.997403:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863530.997406:0:8142:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788863530.997409:0:8142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788863530.997461:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788863530.997483:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863530.997495:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863530.997506:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863531.180554:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863531.500759:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863531.500791:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226437504:0@lo:41: 00000100:00100000:2.0:1788863531.500888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863531.501587:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226437632:0@lo:41: 00000100:00100000:3.0:1788863531.501630:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863531.501760:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226437504 00000100:00100000:0.0:1788863531.501771:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226437504 00000100:00100000:0.0:1788863531.501814:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226437632 00000100:00100000:0.0:1788863531.501817:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226437632 00000100:00100000:0.0:1788863531.501906:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863531.501917:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226437504:12345-0@lo:41: 00000004:00000024:0.0:1788863531.501968:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788863531.502529:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226437760:0@lo:400: 00000100:00100000:2.0:1788863531.502569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863531.502614:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863531.502620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226437888:0@lo:400: 00000100:00100000:2.0:1788863531.502645:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863531.502680:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226437760 00000100:00100000:2.0:1788863531.502687:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226437760 00000100:00100000:2.0:1788863531.502717:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226437888 00000100:00100000:2.0:1788863531.502721:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226437888 00000100:00100000:2.0:1788863531.502738:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863531.502744:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226437760:12345-0@lo:400: 00000100:00100000:2.0:1788863531.502796:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226437760:12345-0@lo:400: Request processed in 49us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863531.502821:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863531.502831:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863531.502844:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226437888:12345-0@lo:400: 00010000:00080000:2.0:1788863531.502871:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e655c47480 x1875759226437760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863531.502885:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226437888:12345-0@lo:400: Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863531.502889:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226437760:0@lo:400: 00000100:00100000:1.0:1788863531.502898:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788863531.502919:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e655c46d80 x1875759226437888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863531.502931:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226437888:0@lo:400: 00000100:00100000:0.0:1788863531.517098:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226437504:12345-0@lo:41: Request processed in 15156us (16183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863531.517115:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863531.517157:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863531.517170:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226437632:12345-0@lo:41: 00000004:00000024:0.0:1788863531.517210:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788863531.517278:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226437632:12345-0@lo:41: Request processed in 114us (15647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863531.517284:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788863531.525856:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226437504:0@lo:41: 00000100:00100000:3.0:1788863531.525967:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226437632:0@lo:41: 00010000:00010000:0.0:1788863532.203276:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863533.231194:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863534.251880:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863535.276700:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863536.299278:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863536.621929:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226438016:0@lo:400: 00000100:00100000:3.0:1788863536.622012:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863536.622062:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226438528:0@lo:400: 00000100:00100000:3.0:1788863536.622102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863536.622146:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788863536.622153:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226438144:0@lo:400: 00000100:00100000:3.0:1788863536.622180:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863536.622197:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226438656:0@lo:41: 00000100:00100000:3.0:1788863536.622216:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863536.622249:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438016 00000100:00100000:3.0:1788863536.622257:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438016 00000100:00100000:3.0:1788863536.622303:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788863536.622313:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:3640:x1875759226438016:12345-0@lo:400: 00000100:00100000:3.0:1788863536.622366:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:3640:x1875759226438016:12345-0@lo:400: Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863536.622374:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788863536.622406:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438528 00000100:00100000:3.0:1788863536.622410:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438528 00000100:00100000:3.0:1788863536.622426:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438656 00000100:00100000:3.0:1788863536.622428:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438656 00000100:00100000:3.0:1788863536.622452:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788863536.622457:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226438528:12345-0@lo:400: 00000100:00100000:3.0:1788863536.622490:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226438528:12345-0@lo:400: Request processed in 33us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863536.622496:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788863536.622507:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788863536.622512:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226438656:12345-0@lo:41: 00000004:00000024:3.0:1788863536.622536:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788863536.622565:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226438656:12345-0@lo:41: Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863536.622571:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788863536.622626:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226438656:0@lo:41: 00000100:00100000:3.0:1788863536.622636:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226438016:0@lo:400: 00000100:00100000:3.0:1788863536.622645:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226438528:0@lo:400: 00000100:00100000:3.0:1788863536.623374:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226438272:0@lo:400: 00000100:00100000:3.0:1788863536.623410:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863536.623430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226438400:0@lo:400: 00000100:00100000:3.0:1788863536.623444:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226438784:0@lo:41: 00000100:00100000:3.0:1788863536.623475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863536.623505:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438272 00000100:00100000:3.0:1788863536.623510:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438272 00000100:00100000:3.0:1788863536.623531:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438784 00000100:00100000:3.0:1788863536.623534:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438784 00000100:00100000:2.0:1788863536.623542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863536.623552:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863536.623560:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226438272:12345-0@lo:400: 00000100:00100000:2.0:1788863536.623589:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438144 00000100:00100000:3.0:1788863536.623605:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226438272:12345-0@lo:400: Request processed in 46us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863536.623618:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863536.623633:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863536.623639:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226438784:12345-0@lo:41: 00000004:00000024:3.0:1788863536.623658:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788863536.623686:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226438784:12345-0@lo:41: Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863536.623692:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863536.623720:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226438272:0@lo:400: 00000100:00100000:3.0:1788863536.623733:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226438784:0@lo:41: 00000100:00100000:2.0:1788863536.623998:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438144 00000100:00100000:2.0:1788863536.624039:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438400 00000100:00100000:2.0:1788863536.624043:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438400 00000100:00100000:2.0:1788863536.624062:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863536.624069:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226438144:12345-0@lo:400: 00000100:00100000:2.0:1788863536.624563:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226438144:12345-0@lo:400: Request processed in 494us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863536.624572:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863536.624589:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863536.624595:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226438400:12345-0@lo:400: 00000100:00100000:2.0:1788863536.624778:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226438400:12345-0@lo:400: Request processed in 183us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863536.624785:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788863536.624827:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e676156680 x1875759226438400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863536.624842:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226438400:0@lo:400: 00010000:00080000:2.0:1788863536.627996:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e676157800 x1875759226438144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863536.628017:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226438144:0@lo:400: 00000020:01000004:3.0:1788863537.023463:0:8443:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788863537.023468:0:8443:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788863537.023469:0:8443:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788863537.023617:0:8443:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e67afa4000 00000020:01000004:3.0:1788863537.023639:0:8443:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788863537.023652:0:8443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788863537.023668:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89e67613cd40) 00000020:00000080:3.0:1788863537.023688:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788863537.072155:0:8443:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788863537.072230:0:8443:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788863537.096630:0:8443:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788863537.096875:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788863537.096888:0:8443:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788863537.096903:0:8443:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf569beb9d4b68a83 00000020:01000004:0.0:1788863537.096910:0:8443:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788863537.096936:0:8443:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788863537.096940:0:8443:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788863537.096948:0:8443:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788863537.096953:0:8443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788863537.096964:0:8443:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89e6586299c0) 00000020:00000080:0.0:1788863537.096977:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788863537.105585:0:8443:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863537.105812:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788863537.105820:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788863537.106878:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788863537.106887:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788863537.109569:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788863537.109582:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788863537.118388:0:8443:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863537.119340:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788863537.119350:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788863537.120065:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788863537.120262:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788863537.144594:0:8443:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863537.144863:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788863537.144871:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788863537.145926:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788863537.145934:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788863537.147327:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788863537.147338:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788863537.151009:0:8443:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863537.151641:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788863537.151650:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788863537.152566:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788863537.152575:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788863537.228995:0:8443:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863537.229231:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788863537.229243:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788863537.231969:0:8443:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788863537.231987:0:8443:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788863537.235320:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788863537.235369:0:8443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788863537.236016:0:8443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788863537.288350:0:8443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788863537.288393:0:8443:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788863537.288399:0:8443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788863537.288401:0:8443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863537.288402:0:8443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863537.288404:0:8443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863537.288405:0:8443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863537.288406:0:8443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863537.288408:0:8443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863537.288410:0:8443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863537.288412:0:8443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863537.288414:0:8443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863537.288415:0:8443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788863537.288419:0:8443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788863537.288422:0:8443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863537.288423:0:8443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863537.288425:0:8443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863537.288426:0:8443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863537.288427:0:8443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863537.288433:0:8443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863537.288434:0:8443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863537.288435:0:8443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863537.288687:0:8443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863537.288689:0:8443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863537.288689:0:8443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788863537.288719:0:8443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788863537.288740:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226438912:0@lo:253: 00000100:00100000:1.0:1788863537.288814:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.288886:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.288888:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226438912 00000100:00100000:2.0:1788863537.288899:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226438912 00000100:00100000:2.0:1788863537.288964:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863537.288974:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8443:x1875759226438912:12345-0@lo:253: 20000000:01000000:2.0:1788863537.289019:0:6532:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788863537.289023:0:6532:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788863537.289028:0:6532:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788863537.289032:0:6532:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788863537.289263:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863537.289577:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788863537.289592:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788863537.289609:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788863537.289614:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788863537.289638:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788863537.289654:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788863537.289739:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788863537.289756:0:6532:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:2.0:1788863537.289757:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:2.0:1788863537.289771:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788863537.289777:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788863537.289790:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788863537.289795:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:2.0:1788863537.289806:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788863537.289812:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788863537.289825:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788863537.289839:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788863537.289915:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788863537.290118:0:6532:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:2.0:1788863537.290129:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:2.0:1788863537.290152:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788863537.290159:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788863537.290172:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788863537.290176:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:2.0:1788863537.290187:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788863537.290193:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788863537.290205:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788863537.290219:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788863537.292244:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788863537.292273:0:6532:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:2.0:1788863537.292275:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:2.0:1788863537.292293:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788863537.292298:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788863537.292549:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788863537.292558:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:2.0:1788863537.292571:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788863537.292578:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788863537.292591:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788863537.292607:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788863537.292622:0:6532:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788863537.292625:0:6532:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788863537.292629:0:6532:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788863537.292668:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788863537.292671:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788863537.300851:0:8463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788863537.300906:0:8463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788863537.300920:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788863537.301249:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788863537.301269:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788863537.301280:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788863537.301289:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788863537.301292:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788863537.301804:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788863537.301824:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788863537.301837:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788863537.301974:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788863537.301989:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788863537.302009:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788863537.302017:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788863537.302019:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788863537.302754:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788863537.302917:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788863537.302951:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788863537.302965:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788863537.302974:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788863537.302976:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788863537.303520:0:8466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788863537.303542:0:8466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788863537.303558:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788863537.309229:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788863537.309272:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788863537.309285:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:3.0:1788863537.309301:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788863537.309335:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309354:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031800/0xf569beb9d4b6895d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309361:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b689d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309367:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114400/0xf569beb9d4b68a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309373:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650115800/0xf569beb9d4b68a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309531:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309539:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309587:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309604:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 18 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.309643:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439040:0@lo:104: 00000100:00100000:3.0:1788863537.309721:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863537.309780:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650115800/0xf569beb9d4b68a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309788:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e650115800/0xf569beb9d4b68a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 18 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.309795:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439168:0@lo:104: 00000100:00100000:3.0:1788863537.309816:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863537.309861:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114400/0xf569beb9d4b68a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309869:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e650114400/0xf569beb9d4b68a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 18 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.309877:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439296:0@lo:104: 00000100:00100000:3.0:1788863537.309897:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863537.309946:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b689d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.309954:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b689d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 18 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.309961:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439424:0@lo:104: 00000100:00100000:3.0:1788863537.309983:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863537.309997:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031800/0xf569beb9d4b6895d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310013:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e640031800/0xf569beb9d4b6895d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 18 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.310022:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439552:0@lo:104: 00000100:00100000:3.0:1788863537.310054:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.310067:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681c5e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863537.310124:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439040 00000100:00100000:3.0:1788863537.310134:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439040 00000100:00100000:3.0:1788863537.310170:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439168 00000100:00100000:3.0:1788863537.310172:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439168 00000100:00100000:3.0:1788863537.310180:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439296 00000100:00100000:3.0:1788863537.310182:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439296 00000100:00100000:3.0:1788863537.310189:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439424 00000100:00100000:3.0:1788863537.310191:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439424 00000100:00100000:3.0:1788863537.310197:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439552 00000100:00100000:3.0:1788863537.310199:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439552 00000100:00100000:3.0:1788863537.310211:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863537.310219:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+7:6532:x1875759226439040:12345-0@lo:104: 00010000:00010000:3.0:1788863537.310232:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310280:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863537.310286:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+7:6532:x1875759226439040:12345-0@lo:104: Request processed in 68us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863537.310293:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863537.310309:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863537.310314:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:6532:x1875759226439168:12345-0@lo:104: 00010000:00010000:3.0:1788863537.310321:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310363:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788863537.310368:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:6532:x1875759226439168:12345-0@lo:104: Request processed in 55us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863537.310374:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863537.310386:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863537.310391:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:6532:x1875759226439296:12345-0@lo:104: 00010000:00010000:3.0:1788863537.310398:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310423:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788863537.310427:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:6532:x1875759226439296:12345-0@lo:104: Request processed in 37us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863537.310432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863537.310443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863537.310448:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6532:x1875759226439424:12345-0@lo:104: 00010000:00010000:3.0:1788863537.310456:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310478:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788863537.310482:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6532:x1875759226439424:12345-0@lo:104: Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863537.310487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863537.310496:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863537.310501:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6532:x1875759226439552:12345-0@lo:104: 00010000:00010000:3.0:1788863537.310508:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310548:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788863537.310554:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6532:x1875759226439552:12345-0@lo:104: Request processed in 52us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863537.310560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788863537.310576:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788863537.310582:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310589:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537e00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863537.310593:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310601:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863537.310608:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863537.310613:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863537.310642:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310649:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863537.310668:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310674:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b68a4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a52 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310697:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788863537.310700:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310705:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863537.310708:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310715:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863537.310721:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863537.310726:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863537.310738:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310743:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863537.310758:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310764:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b68a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a28 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310772:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788863537.310775:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310789:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863537.310792:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310798:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863537.310803:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863537.310808:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863537.310820:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310826:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863537.310831:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310837:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641536600/0xf569beb9d4b68a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310857:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863537.310860:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310866:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863537.310868:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310884:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863537.310891:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863537.310896:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863537.310910:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310915:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863537.310921:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310926:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b689cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689d4 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310936:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863537.310940:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310945:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114e00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863537.310948:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310954:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863537.310959:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863537.310969:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863537.310984:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310989:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863537.310993:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.310999:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6895d expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.311012:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863537.311014:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863537.311015:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863537.311036:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226439680:0@lo:103: 00000100:00100000:3.0:1788863537.311067:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.311104:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226440192:0@lo:103: 00000100:00100000:3.0:1788863537.311123:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.311142:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863537.311147:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226440064:0@lo:103: 00000100:00100000:3.0:1788863537.311165:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.311190:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226439808:0@lo:103: 00000100:00100000:3.0:1788863537.311209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.311219:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863537.311223:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226439936:0@lo:103: 00000100:00100000:3.0:1788863537.311243:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.311278:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439040:0@lo:104: 00000100:00100000:3.0:1788863537.311296:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439168:0@lo:104: 00000100:00100000:3.0:1788863537.311302:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439296:0@lo:104: 00000100:00100000:3.0:1788863537.311310:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439424:0@lo:104: 00000100:00100000:3.0:1788863537.311316:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6532:1875759226439552:0@lo:104: 00010000:00010000:3.0:1788863537.311338:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.311477:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863537.311490:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439680 00000100:00100000:0.0:1788863537.311496:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439680 00010000:00010000:0.0:1788863537.311518:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 19 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.311534:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440192 00000100:00100000:0.0:1788863537.311536:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440192 00010000:00010000:0.0:1788863537.311547:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031800/0xf569beb9d4b6895d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 20 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.311556:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440064 00000100:00100000:0.0:1788863537.311559:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440064 00010000:00010000:0.0:1788863537.311567:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b689d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 21 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.311575:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439808 00000100:00100000:0.0:1788863537.311577:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439808 00010000:00010000:0.0:1788863537.311585:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650115800/0xf569beb9d4b68a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 22 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.311612:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226439936 00000100:00100000:0.0:1788863537.311615:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226439936 00010000:00010000:0.0:1788863537.311626:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114400/0xf569beb9d4b68a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 23 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.311637:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863537.311643:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:3643:x1875759226439680:12345-0@lo:103: 00010000:00010000:0.0:1788863537.311653:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863537.311658:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 23 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.311667:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 23 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.311680:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68a4b expref: 23 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.311692:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863537.311734:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3643:x1875759226439680:12345-0@lo:103: Request processed in 92us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.311741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863537.311754:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788863537.311759:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3643:x1875759226440192:12345-0@lo:103: 00010000:00010000:0.0:1788863537.311766:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863537.311770:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031800/0xf569beb9d4b6895d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 21 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.311777:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031800/0xf569beb9d4b6895d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 21 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.311793:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031800/0xf569beb9d4b6895d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68956 expref: 21 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.311801:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863537.311824:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:3643:x1875759226440192:12345-0@lo:103: Request processed in 65us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.311830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788863537.311853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863537.312015:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:3643:x1875759226440064:12345-0@lo:103: 00010000:00010000:0.0:1788863537.312026:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863537.312031:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b689d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 19 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.312039:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b689d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 19 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.312049:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b689d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b689cd expref: 19 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.312057:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863537.312148:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:3643:x1875759226440064:12345-0@lo:103: Request processed in 289us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.312154:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863537.312170:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863537.312177:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3640:x1875759226439808:12345-0@lo:103: 00010000:00010000:0.0:1788863537.312186:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863537.312190:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650115800/0xf569beb9d4b68a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 17 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.312205:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650115800/0xf569beb9d4b68a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 17 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.312214:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115800/0xf569beb9d4b68a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68a21 expref: 17 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.312221:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863537.312253:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:3640:x1875759226439808:12345-0@lo:103: Request processed in 77us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.312259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863537.312271:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788863537.312278:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3640:x1875759226439936:12345-0@lo:103: 00010000:00010000:0.0:1788863537.312285:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863537.312291:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114400/0xf569beb9d4b68a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 15 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.312298:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114400/0xf569beb9d4b68a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 15 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863537.313195:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226439808:0@lo:103: 00010000:00010000:0.0:1788863537.313267:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114400/0xf569beb9d4b68a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68a05 expref: 15 pid: 6529 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313287:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313295:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313444:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313463:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313470:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313476:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313482:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863537.313487:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.313496:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.313616:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226440064:0@lo:103: 00000100:00100000:3.0:1788863537.313626:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226439680:0@lo:103: 00000100:00100000:3.0:1788863537.313634:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226440192:0@lo:103: 00010000:00010000:2.0:1788863537.321643:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.321663:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863537.321672:0:6532:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788863537.322530:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.322544:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68a91 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.322571:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863537.322720:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:3640:x1875759226439936:12345-0@lo:103: Request processed in 10438us (11471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.322731:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788863537.324542:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863537.325646:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226439936:0@lo:103: 00000100:00100000:2.0:1788863537.329113:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:8443:x1875759226438912:12345-0@lo:253: Request processed in 40131us (40289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.329129:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788863537.331687:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226438912:0@lo:253: 10000000:01000000:1.0:1788863537.331720:0:8443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788863537.331726:0:8443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863537.331729:0:8443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863537.331730:0:8443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863537.331732:0:8443:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788863537.331734:0:8443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863537.331736:0:8443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863537.331737:0:8443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863537.331739:0:8443:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788863537.331741:0:8443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863537.331742:0:8443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788863537.331794:0:8443:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e67afa4000 from lustre-OST0000 10000000:01000000:1.0:1788863537.331858:0:8443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788863537.331863:0:8443:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788863537.331874:0:8443:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e671354d40 local copy 10000000:01000000:1.0:1788863537.331880:0:8443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788863537.331938:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.331951:0:8443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.331962:0:8443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863537.332192:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440320:0@lo:101: 00000100:00100000:1.0:1788863537.332359:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.332428:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863537.333525:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440320 00000100:00100000:0.0:1788863537.333542:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440320 00000100:00100000:0.0:1788863537.333623:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788863537.333635:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+13:8443:x1875759226440320:12345-0@lo:101: 00010000:00010000:0.0:1788863537.333672:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863537.333697:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640030400/0xf569beb9d4b68a9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68a98 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.333726:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640030400/0xf569beb9d4b68a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68a98 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.333739:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640030400/0xf569beb9d4b68a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a98 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.333747:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030400, rc 0) 00000100:00100000:0.0:1788863537.333822:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226440320:12345-0@lo:101: Request processed in 189us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.333829:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788863537.336820:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440320:0@lo:101: 00010000:00010000:1.0:1788863537.336873:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.336890:0:8443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863537.337163:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440448:0@lo:501: 00000100:00100000:1.0:1788863537.337867:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.337951:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.337964:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440448 00000100:00100000:2.0:1788863537.337986:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440448 00000100:00100000:2.0:1788863537.338111:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788863537.338121:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226440448:12345-0@lo:501: 00000100:00100000:2.0:1788863537.338270:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226440448:12345-0@lo:501: Request processed in 150us (405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863537.338277:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788863537.340545:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440448:0@lo:501: 10000000:01000000:1.0:1788863537.340590:0:8443:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788863537.340665:0:8443:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788863537.340679:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.340693:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.340701:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.340868:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788863537.340928:0:8443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e67afa4000 10000000:01000000:1.0:1788863537.340935:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788863537.340943:0:8443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788863537.340945:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863537.340951:0:8443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788863537.340954:0:8443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863537.341239:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.341250:0:8443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.341265:0:8443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863537.341295:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440576:0@lo:101: 00000100:00100000:1.0:1788863537.341383:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.341452:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.341511:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440576 00000100:00100000:2.0:1788863537.341528:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440576 00000100:00100000:2.0:1788863537.341612:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788863537.341622:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226440576:12345-0@lo:101: 00010000:00010000:2.0:1788863537.341641:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863537.341662:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68aa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.341695:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.341706:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.341715:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641536600, rc 0) 00000100:00100000:2.0:1788863537.341801:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226440576:12345-0@lo:101: Request processed in 181us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.341808:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:0.0:1788863537.342112:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863537.342125:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.342132:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650115400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863537.342136:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.342146:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863537.342153:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863537.342158:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863537.342190:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.342209:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788863537.342270:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863537.342291:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440576:0@lo:101: 00010000:00010000:1.0:1788863537.342319:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.342332:0:8443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863537.342454:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440832:0@lo:501: 00000100:00100000:1.0:1788863537.342500:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.342551:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788863537.342597:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.342608:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68a98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68a9f expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.342623:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863537.342626:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863537.342628:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863537.342684:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440832 00000100:00100000:2.0:1788863537.342691:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440832 00000100:00100000:2.0:1788863537.342738:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788863537.342748:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226440832:12345-0@lo:501: 00000100:00100000:2.0:1788863537.342896:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226440832:12345-0@lo:501: Request processed in 150us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.342903:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788863537.343882:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226440704:0@lo:103: 00000100:00100000:1.0:1788863537.343939:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440832:0@lo:501: 00000100:00100000:2.0:1788863537.344030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.344990:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440960:0@lo:503: 00000100:00100000:1.0:1788863537.345250:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.345293:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863537.345945:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440960 00000100:00100000:3.0:1788863537.345958:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440960 00000100:00100000:3.0:1788863537.346396:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788863537.346410:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226440960:12345-0@lo:503: 00000100:00100000:3.0:1788863537.346610:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226440960:12345-0@lo:503: Request processed in 204us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863537.346618:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788863537.348219:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226440960:0@lo:503: 00000040:00080000:1.0:1788863537.348640:0:8443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863537.349481:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226440704 00000100:00100000:0.0:1788863537.349499:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226440704 00000100:00100000:0.0:1788863537.349585:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863537.349597:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3641:x1875759226440704:12345-0@lo:103: 00010000:00010000:0.0:1788863537.349612:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863537.349633:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640030400/0xf569beb9d4b68a9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68a98 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.349652:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863537.349733:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:3641:x1875759226440704:12345-0@lo:103: Request processed in 140us (5704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.349740:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863537.349788:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226440704:0@lo:103: 00000100:00100000:1.0:1788863537.350947:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441088:0@lo:502: 00000100:00100000:1.0:1788863537.351070:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.351330:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863537.351486:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441088 00000100:00100000:0.0:1788863537.351499:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441088 00000100:00100000:0.0:1788863537.351574:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863537.351583:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226441088:12345-0@lo:502: 00000100:00100000:0.0:1788863537.351780:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226441088:12345-0@lo:502: Request processed in 197us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.351788:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788863537.351959:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441088:0@lo:502: 00000040:00080000:1.0:1788863537.352349:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788863537.352384:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788863537.352396:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788863537.352407:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788863537.352418:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788863537.352429:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788863537.352462:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441216:0@lo:502: 00000100:00100000:1.0:1788863537.352515:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.352640:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.355139:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441216 00000100:00100000:2.0:1788863537.355438:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441216 00000100:00100000:2.0:1788863537.358686:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788863537.358723:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226441216:12345-0@lo:502: 00000100:00100000:2.0:1788863537.359167:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226441216:12345-0@lo:502: Request processed in 464us (6650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.359177:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788863537.359522:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441216:0@lo:502: 00000040:00080000:1.0:1788863537.359644:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788863537.359662:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788863537.361390:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788863537.361405:0:8467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788863537.361413:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863537.361417:0:8467:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788863537.361425:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863537.361449:0:8467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89e6763c4d40) 00000020:00000080:1.0:1788863537.361499:0:8467:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788863537.361507:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788863537.361634:0:8467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67afa4000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788863537.361644:0:8467:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788863537.361652:0:8467:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf569beb9d4b68abb 00010000:00010000:1.0:1788863537.371227:0:8467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788863537.371659:0:8467:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788863537.384651:0:8467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788863537.387355:0:8467:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788863537.400981:0:8467:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788863537.401204:0:8467:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788863537.418785:0:8467:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788863537.427812:0:8467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788863537.427828:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863537.427837:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863537.427850:0:8467:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788863537.427854:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863537.427859:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863537.427861:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788863537.427864:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788863537.427866:0:8467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788863537.427898:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863537.427901:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863537.427902:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788863537.427906:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788863537.428209:0:8443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788863537.428290:0:8443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788863537.428310:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.428325:0:8443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863537.428333:0:8443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67afa4000 from 1 10000000:01000000:0.0:1788863537.428336:0:8443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863537.428380:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.428389:0:8443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.428400:0:8443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.428446:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441344:0@lo:101: 00000100:00100000:0.0:1788863537.428525:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863537.428594:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.428906:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441344 00000100:00100000:2.0:1788863537.428915:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441344 00000100:00100000:2.0:1788863537.428991:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863537.429002:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:8443:x1875759226441344:12345-0@lo:101: 00010000:00010000:2.0:1788863537.429017:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863537.429031:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68ac2 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.429057:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.429067:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.429102:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537e00, rc 0) 00000100:00100000:2.0:1788863537.429146:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441344:12345-0@lo:101: Request processed in 147us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.429153:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788863537.429397:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441344:0@lo:101: 00010000:00010000:0.0:1788863537.429509:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.429520:0:8443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.429629:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441472:0@lo:501: 00000100:00100000:0.0:1788863537.429662:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863537.429686:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.429950:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441472 00000100:00100000:2.0:1788863537.429955:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441472 00000100:00100000:2.0:1788863537.429993:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788863537.430001:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441472:12345-0@lo:501: 00000100:00100000:2.0:1788863537.430121:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441472:12345-0@lo:501: Request processed in 121us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.430136:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788863537.430237:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441472:0@lo:501: 00000100:00100000:0.0:1788863537.430283:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441600:0@lo:503: 00000100:00100000:0.0:1788863537.430324:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863537.430344:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.430394:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441600 00000100:00100000:2.0:1788863537.430399:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441600 00000100:00100000:2.0:1788863537.430560:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788863537.430568:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441600:12345-0@lo:503: 00000100:00100000:2.0:1788863537.430654:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441600:12345-0@lo:503: Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.430660:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788863537.430980:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441600:0@lo:503: 00000040:00080000:0.0:1788863537.431258:0:8443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863537.431354:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441728:0@lo:502: 00000100:00100000:0.0:1788863537.431405:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863537.431539:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441728 00000100:00100000:2.0:1788863537.431545:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441728 00000100:00100000:2.0:1788863537.431575:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788863537.431584:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441728:12345-0@lo:502: 00000100:00100000:2.0:1788863537.431666:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441728:12345-0@lo:502: Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.431672:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788863537.432069:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863537.432122:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441728:0@lo:502: 00000040:00080000:0.0:1788863537.432319:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788863537.432345:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788863537.432373:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441856:0@lo:502: 00000100:00100000:2.0:1788863537.432931:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863537.433000:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863537.433047:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441856 00000100:00100000:0.0:1788863537.433054:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441856 00000100:00100000:0.0:1788863537.433211:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788863537.433219:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441856:12345-0@lo:502: 00000100:00100000:0.0:1788863537.433354:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441856:12345-0@lo:502: Request processed in 134us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.433362:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788863537.433974:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441856:0@lo:502: 00000040:00080000:1.0:1788863537.440827:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788863537.440865:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788863537.452559:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863537.452583:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863537.452586:0:8470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788863537.452596:0:8470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e67afa4000 00000020:00000080:3.0:1788863537.452599:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863537.452619:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863537.452622:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863537.452644:0:8470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788863537.452648:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788863537.455633:0:8443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788863537.455693:0:8443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863537.455724:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.456983:0:8443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863537.457091:0:8443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788863537.457094:0:8443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e67afa4000 10000000:01000000:0.0:1788863537.457098:0:8443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e67afa4000 10000000:01000000:0.0:1788863537.457103:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863537.457111:0:8443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e67afa4000 from 1 10000000:01000000:0.0:1788863537.457114:0:8443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863537.457160:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.457170:0:8443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863537.457181:0:8443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863537.457209:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441984:0@lo:101: 00000100:00100000:0.0:1788863537.457286:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.457377:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226441984 00000100:00100000:1.0:1788863537.457396:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226441984 00000100:00100000:1.0:1788863537.457475:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788863537.457491:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8443:x1875759226441984:12345-0@lo:101: 00010000:00010000:1.0:1788863537.457514:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863537.457537:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68ad0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.457590:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.457604:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863537.457614:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114e00, rc 0) 00000100:00100000:1.0:1788863537.457695:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226441984:12345-0@lo:101: Request processed in 209us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863537.457703:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788863537.462039:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863537.462134:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226441984:0@lo:101: 00010000:00010000:3.0:1788863537.462164:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.462182:0:8443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.462335:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442112:0@lo:501: 00000100:00100000:3.0:1788863537.462402:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.462452:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863537.463673:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226442112 00000100:00100000:0.0:1788863537.463702:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226442112 00000100:00100000:0.0:1788863537.463774:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788863537.463786:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442112:12345-0@lo:501: 00000100:00100000:0.0:1788863537.463975:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442112:12345-0@lo:501: Request processed in 191us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.463983:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863537.464401:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442112:0@lo:501: 00000100:00100000:3.0:1788863537.464472:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442240:0@lo:503: 00000100:00100000:3.0:1788863537.465945:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.466004:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863537.466042:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226442240 00000100:00100000:1.0:1788863537.466059:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226442240 00000100:00100000:1.0:1788863537.466460:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788863537.466473:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442240:12345-0@lo:503: 00000100:00100000:1.0:1788863537.466680:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442240:12345-0@lo:503: Request processed in 209us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863537.466690:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863537.466811:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442240:0@lo:503: 00000040:00080000:3.0:1788863537.467236:0:8443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788863537.467349:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442368:0@lo:502: 00000100:00100000:3.0:1788863537.467857:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863537.476148:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226442368 00000100:00100000:3.0:1788863537.476171:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226442368 00000100:00100000:3.0:1788863537.476255:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788863537.476270:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442368:12345-0@lo:502: 00000100:00100000:3.0:1788863537.476494:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442368:12345-0@lo:502: Request processed in 228us (8636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863537.476514:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788863537.476682:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863537.476721:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442368:0@lo:502: 00000040:00080000:3.0:1788863537.479167:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788863537.481530:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788863537.481612:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788863537.481631:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788863537.481645:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788863537.481659:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788863537.481674:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788863537.481687:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788863537.481701:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788863537.481715:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788863537.481728:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788863537.481743:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788863537.481756:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788863537.481798:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788863537.481812:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788863537.481826:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788863537.481854:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788863537.481871:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788863537.481883:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788863537.481896:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788863537.481910:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788863537.481923:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788863537.481937:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788863537.481953:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788863537.481966:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788863537.481979:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788863537.481991:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788863537.482004:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788863537.482019:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788863537.482032:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788863537.482046:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788863537.482059:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788863537.482073:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788863537.482257:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788863537.482273:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788863537.482287:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788863537.482299:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788863537.482364:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442496:0@lo:502: 00000100:00100000:2.0:1788863537.482481:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863537.482551:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226442496 00000100:00100000:2.0:1788863537.482556:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642eb5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863537.482566:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226442496 00000100:00100000:1.0:1788863537.482632:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788863537.482643:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442496:12345-0@lo:502: 00000100:00100000:1.0:1788863537.482922:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226442496:12345-0@lo:502: Request processed in 280us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863537.482932:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788863537.485229:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226442496:0@lo:502: 00000040:00080000:2.0:1788863537.485393:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788863537.485412:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788863537.489182:0:8472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788863537.489210:0:8472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89e67613b380) 00000020:00000080:3.0:1788863537.489244:0:8472:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788863537.489345:0:8472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67afa4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788863537.489350:0:8472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67afa4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788863537.489353:0:8472:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67afa4000 3 00010000:00080000:3.0:1788863537.489392:0:8472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e5425cf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788863537.491277:0:8472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788863537.491545:0:8472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788863537.491598:0:8472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788863537.491615:0:8472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf569beb9d4b68ae5 00000100:00080000:3.0:1788863537.491629:0:8472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863537.491645:0:8472:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425cf800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863537.491698:0:8472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e541ef6680 x1875759226442624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863537.491737:0:8472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788863537.491998:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226442752:0@lo:400: 00000100:00100000:0.0:1788863537.492105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863537.492145:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863537.492150:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226443136:0@lo:400: 00000100:00100000:0.0:1788863537.492199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863537.492232:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226442880:0@lo:400: 00000100:00100000:0.0:1788863537.492256:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863537.492272:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863537.492276:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226443008:0@lo:400: 00000100:00100000:0.0:1788863537.492296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863537.492337:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443136 00000100:00100000:0.0:1788863537.492346:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443136 00000100:00100000:0.0:1788863537.492384:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226442880 00000100:00100000:0.0:1788863537.492387:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226442880 00000100:00100000:0.0:1788863537.492405:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863537.492416:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226443136:12345-0@lo:400: 00000100:00100000:0.0:1788863537.492487:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226443136:12345-0@lo:400: Request processed in 72us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.492495:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863537.492512:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863537.492519:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226442880:12345-0@lo:400: 00000100:00100000:0.0:1788863537.492562:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226442880:12345-0@lo:400: Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.492569:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863537.492613:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226442880:0@lo:400: 00000100:00100000:0.0:1788863537.492641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226443136:0@lo:400: 00000100:00100000:2.0:1788863537.495143:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226442624:0@lo:38: 00000100:00100000:2.0:1788863537.495257:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863537.495360:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226442752 00000100:00100000:2.0:1788863537.495370:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226442752 00000100:00100000:2.0:1788863537.495414:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443008 00000100:00100000:2.0:1788863537.495418:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443008 00000100:00100000:2.0:1788863537.495430:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226442624 00000100:00100000:2.0:1788863537.495433:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226442624 00000100:00100000:2.0:1788863537.495450:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863537.495459:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226442752:12345-0@lo:400: 00000100:00100000:2.0:1788863537.495528:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226442752:12345-0@lo:400: Request processed in 70us (3424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.495535:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863537.495553:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863537.495559:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226443008:12345-0@lo:400: 00000100:00100000:2.0:1788863537.495591:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226443008:12345-0@lo:400: Request processed in 32us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.495597:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863537.495607:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863537.495611:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226442624:12345-0@lo:38: 00010000:00080000:2.0:1788863537.495657:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1788863537.495706:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf569beb9d4b68aec 00000004:00100000:2.0:1788863537.495726:0:6537:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788863537.495766:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e541e70000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863537.495822:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875759226442624:12345-0@lo:38: Request processed in 209us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.495829:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788863537.495898:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e541ef6680 x1875759226442624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863537.495916:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788863537.495926:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788863537.495936:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788863537.495941:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788863537.495944:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425cf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788863537.495950:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226442624:0@lo:38: 00010000:00080000:2.0:1788863537.495991:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e6712a9c00 x1875759226443008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863537.496002:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226443008:0@lo:400: 00010000:00080000:2.0:1788863537.496028:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e6712ab800 x1875759226442752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863537.496037:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226442752:0@lo:400: 00000020:01000004:2.0:1788863537.500891:0:8472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788863537.500919:0:8472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff89e680dd99c0) 00000020:00000080:2.0:1788863537.500950:0:8472:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788863537.501121:0:8472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67afa4000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788863537.501127:0:8472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67afa4000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788863537.501130:0:8472:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67afa4000 3 00010000:00080000:2.0:1788863537.501171:0:8472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e541e73000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863537.508457:0:8472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788863537.508778:0:8472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788863537.508902:0:8472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863537.508920:0:8472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf569beb9d4b68afa 00000100:00080000:2.0:1788863537.508933:0:8472:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863537.508948:0:8472:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89e541e73000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863537.509008:0:8472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e655c45180 x1875759226443264/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863537.509096:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226443264:0@lo:38: 00000100:00100000:0.0:1788863537.509194:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788863537.509633:0:8472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788863537.515039:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443264 00000100:00100000:0.0:1788863537.515058:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443264 00000100:00100000:0.0:1788863537.515144:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863537.515156:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226443264:12345-0@lo:38: 00010000:00080000:0.0:1788863537.515199:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1788863537.515247:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf569beb9d4b68b01 00000004:00100000:0.0:1788863537.515270:0:6537:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788863537.515315:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e5425b6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863537.515436:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875759226443264:12345-0@lo:38: Request processed in 281us (6242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863537.515444:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788863537.515520:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e655c45180 x1875759226443264/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863537.515533:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863537.515543:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788863537.515552:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788863537.515558:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788863537.515560:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e541e73000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788863537.515585:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226443264:0@lo:38: 00000040:00080000:2.0:1788863537.522314:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788863537.522393:0:8443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788863537.522428:0:8443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863537.522448:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.522464:0:8443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788863537.522542:0:8443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788863537.522545:0:8443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788863537.522546:0:8443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863537.522548:0:8443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863537.522549:0:8443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863537.522551:0:8443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863537.522553:0:8443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863537.522554:0:8443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863537.522555:0:8443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863537.522557:0:8443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863537.522558:0:8443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788863537.522563:0:8443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788863537.522566:0:8443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788863537.522567:0:8443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788863537.522569:0:8443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863537.522570:0:8443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863537.522571:0:8443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863537.522572:0:8443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863537.522573:0:8443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863537.522574:0:8443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863537.522575:0:8443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863537.522576:0:8443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863537.522577:0:8443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788863537.522623:0:8443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788863537.522650:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226443392:0@lo:253: 00000100:00100000:2.0:1788863537.522749:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863537.522818:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642eb53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863537.523131:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443392 00000100:00100000:0.0:1788863537.523141:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443392 00000100:00100000:0.0:1788863537.523200:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863537.523211:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226443392:12345-0@lo:253: 20000000:01000000:0.0:1788863537.523245:0:6529:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788863537.523263:0:6529:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788863537.537620:0:6529:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788863537.537677:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788863537.538118:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:8443:x1875759226443392:12345-0@lo:253: Request processed in 14901us (15362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.538135:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 20000000:01000000:3.0:1788863537.538293:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788863537.538299:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788863537.538328:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.538347:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114c00/0xf569beb9d4b689fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.538379:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.538388:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.538439:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.538457:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68a1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 15 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.538476:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226443520:0@lo:104: 00000100:00100000:3.0:1788863537.538524:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863537.538585:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114c00/0xf569beb9d4b689fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.538594:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e650114c00/0xf569beb9d4b689fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 15 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.538601:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226443648:0@lo:104: 00000100:00100000:3.0:1788863537.538621:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541089b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863537.538683:0:6521:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788863537.538702:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863537.538738:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443520 00000100:00100000:2.0:1788863537.538748:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443520 00000100:00100000:0.0:1788863537.538771:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8443:1875759226443392:0@lo:253: 10000000:01000000:0.0:1788863537.538794:0:8443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00100000:2.0:1788863537.538797:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443648 00000020:01000004:0.0:1788863537.538798:0:8443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:2.0:1788863537.538800:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443648 00000020:01000004:0.0:1788863537.538801:0:8443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863537.538802:0:8443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863537.538804:0:8443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863537.538805:0:8443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863537.538807:0:8443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863537.538809:0:8443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863537.538811:0:8443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863537.538812:0:8443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863537.538814:0:8443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1788863537.538815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000020:01000004:0.0:1788863537.538816:0:8443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788863537.538823:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d35c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6552:x1875759226443520:12345-0@lo:104: 00000020:02000000:0.0:1788863537.538846:0:8443:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788863537.538847:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.538893:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863537.538899:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d35c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6552:x1875759226443520:12345-0@lo:104: Request processed in 77us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.538905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863537.538939:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863537.538945:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226443648:12345-0@lo:104: 00010000:00010000:2.0:1788863537.538952:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539004:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788863537.539009:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226443648:12345-0@lo:104: Request processed in 64us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.539016:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788863537.539038:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863537.539045:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539054:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863537.539059:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539070:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863537.539105:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863537.539112:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863537.539142:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539150:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863537.539169:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539176:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114200/0xf569beb9d4b68a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539201:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863537.539204:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539210:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167cc00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863537.539213:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539220:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863537.539228:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863537.539234:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863537.539249:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539256:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863537.539272:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539280:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b689f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b689fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539295:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863537.539297:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863537.539298:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863537.539320:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226443776:0@lo:103: 00000100:00100000:2.0:1788863537.539375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863537.539433:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226443904:0@lo:103: 00000100:00100000:2.0:1788863537.539458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863537.539494:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443776 00000100:00100000:2.0:1788863537.539498:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443776 00010000:00010000:2.0:1788863537.539516:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68a1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 16 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863537.539536:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226443904 00000100:00100000:2.0:1788863537.539538:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226443904 00010000:00010000:2.0:1788863537.539545:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114c00/0xf569beb9d4b689fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 17 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863537.539556:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863537.539562:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3641:x1875759226443776:12345-0@lo:103: 00010000:00010000:2.0:1788863537.539573:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863537.539577:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68a1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 17 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539587:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68a1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 17 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539603:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863537.539628:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3641:x1875759226443776:12345-0@lo:103: Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.539633:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863537.539644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863537.539649:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:3642:x1875759226443904:12345-0@lo:103: 00010000:00010000:2.0:1788863537.539656:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863537.539666:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114c00/0xf569beb9d4b689fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 16 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539674:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114c00/0xf569beb9d4b689fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 16 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539685:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539694:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863537.539708:0:6522:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007510891s 00010000:00010000:2.0:1788863537.539714:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539720:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539727:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539734:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539740:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863537.539746:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539754:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539762:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863537.539779:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863537.539808:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:3642:x1875759226443904:12345-0@lo:103: Request processed in 158us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863537.539815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863537.539862:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226443904:0@lo:103: 00000100:00100000:2.0:1788863537.539881:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226443776:0@lo:103: 00010000:00010000:3.0:1788863537.540040:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68a13 expref: 15 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.540050:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226443520:0@lo:104: 00010000:00010000:3.0:1788863537.540060:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114c00/0xf569beb9d4b689fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b689f7 expref: 14 pid: 6532 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863537.540107:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226443648:0@lo:104: 00010000:00010000:3.0:1788863537.540126:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.540135:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.540143:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.540149:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b08 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863537.540168:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788863537.547291:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788863537.547460:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788863537.547652:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788863537.547930:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788863537.548317:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788863537.548560:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788863537.550361:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788863537.574232:0:8443:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788863537.574250:0:8443:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788863537.574306:0:8443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788863537.574371:0:8443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788863537.574396:0:8443:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788863537.574430:0:8443:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788863537.575567:0:8443:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788863537.575796:0:8443:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788863538.349194:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863538.551033:0:8528:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863538.551552:0:8528:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788863539.371256:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788863539.955623:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788863539.955641:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e648f4b800 from 30 10000000:01000000:1.0:1788863539.955647:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863539.955718:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863539.955730:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863539.955742:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863539.955771:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444032:0@lo:101: 00000100:00100000:1.0:1788863539.955857:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863539.955939:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c657900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863539.956355:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444032 00000100:00100000:0.0:1788863539.956364:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444032 00000100:00100000:0.0:1788863539.956426:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863539.956436:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:6534:x1875759226444032:12345-0@lo:101: 00010000:00010000:0.0:1788863539.956451:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863539.956465:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68b0f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863539.956501:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863539.956512:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863539.956520:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031c00, rc 0) 00000100:00100000:0.0:1788863539.956566:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226444032:12345-0@lo:101: Request processed in 131us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863539.956573:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788863539.956842:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444032:0@lo:101: 00010000:00010000:1.0:1788863539.956859:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863539.956868:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863539.957151:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444160:0@lo:501: 00000100:00100000:1.0:1788863539.957321:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863539.957402:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c657900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863539.962897:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444160 00000100:00100000:0.0:1788863539.962915:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444160 00000100:00100000:0.0:1788863539.963413:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863539.963427:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226444160:12345-0@lo:501: 00000100:00100000:0.0:1788863539.963629:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226444160:12345-0@lo:501: Request processed in 205us (6307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863539.963649:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788863539.963834:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444160:0@lo:501: 00000100:00100000:3.0:1788863539.963919:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444288:0@lo:503: 00000100:00100000:3.0:1788863539.963997:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863539.965354:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863539.965424:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444288 00000100:00100000:1.0:1788863539.965434:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444288 00000100:00100000:1.0:1788863539.965478:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788863539.965487:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226444288:12345-0@lo:503: 00000100:00100000:1.0:1788863539.965646:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226444288:12345-0@lo:503: Request processed in 160us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863539.965653:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788863539.965853:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444288:0@lo:503: 00000100:00100000:3.0:1788863539.966666:0:8595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8595:1875759226444416:0@lo:502: 00000100:00100000:3.0:1788863539.966852:0:8595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863539.966943:0:8595:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541089840 going to sleep for 11 seconds 00000100:00100000:1.0:1788863539.967272:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444416 00000100:00100000:1.0:1788863539.967280:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444416 00000100:00100000:1.0:1788863539.967369:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788863539.967379:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8595:x1875759226444416:12345-0@lo:502: 00000100:00100000:1.0:1788863539.967505:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8595:x1875759226444416:12345-0@lo:502: Request processed in 126us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863539.967512:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788863539.967596:0:8595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8595:1875759226444416:0@lo:502: 00000100:00100000:3.0:1788863539.967664:0:8595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8595:1875759226444544:0@lo:502: 00000100:00100000:3.0:1788863539.967715:0:8595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863539.967992:0:8595:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541089840 going to sleep for 11 seconds 00000100:00100000:2.0:1788863539.968162:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444544 00000100:00100000:2.0:1788863539.968170:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444544 00000100:00100000:2.0:1788863539.968210:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788863539.968219:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8595:x1875759226444544:12345-0@lo:502: 00000100:00100000:2.0:1788863539.968313:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:8595:x1875759226444544:12345-0@lo:502: Request processed in 96us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863539.968333:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788863539.968494:0:8595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8595:1875759226444544:0@lo:502: 00000040:00080000:3.0:1788863539.968517:0:8595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788863539.969107:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788863539.969138:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863539.969150:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.969162:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863539.969295:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863539.969299:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e648f4b800 from 5 10000000:01000000:2.0:1788863539.969302:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863539.969338:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.969348:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.969359:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863539.969379:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444672:0@lo:101: 00000100:00100000:2.0:1788863539.969423:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863539.969469:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863539.969520:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444672 00000100:00100000:3.0:1788863539.969526:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444672 00000100:00100000:3.0:1788863539.969556:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788863539.969564:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226444672:12345-0@lo:101: 00010000:00010000:3.0:1788863539.969575:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863539.969589:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68b1d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863539.969610:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863539.969620:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863539.969629:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167c800, rc 0) 00000100:00100000:3.0:1788863539.969858:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226444672:12345-0@lo:101: Request processed in 116us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863539.969865:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788863539.969945:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444672:0@lo:101: 00010000:00010000:2.0:1788863539.969959:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.969969:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863539.970037:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444800:0@lo:256: 00000100:00100000:2.0:1788863539.970069:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863539.970119:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863539.970299:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444800 00000100:00100000:3.0:1788863539.970304:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444800 00000100:00100000:3.0:1788863539.970322:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788863539.970328:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226444800:12345-0@lo:256: 20000000:01000000:3.0:1788863539.970340:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788863539.970355:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788863539.970361:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788863539.970435:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226444800:12345-0@lo:256: Request processed in 107us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863539.970442:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788863539.970723:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444800:0@lo:256: 10000000:01000000:2.0:1788863539.970767:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863539.970775:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.970782:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863539.970799:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788863539.970802:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788863539.970805:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788863539.970825:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.970832:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.970841:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863539.970856:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444928:0@lo:101: 00000100:00100000:2.0:1788863539.970880:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863539.970900:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863539.970947:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226444928 00000100:00100000:3.0:1788863539.970951:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226444928 00000100:00100000:3.0:1788863539.970969:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788863539.970983:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226444928:12345-0@lo:101: 00010000:00010000:3.0:1788863539.970993:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863539.971003:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68b2b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863539.971023:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863539.971033:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863539.971041:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d200, rc 0) 00000100:00100000:3.0:1788863539.971092:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226444928:12345-0@lo:101: Request processed in 99us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863539.971098:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788863539.971323:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226444928:0@lo:101: 00010000:00010000:2.0:1788863539.971343:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863539.971352:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863539.971405:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226445056:0@lo:501: 00000100:00100000:2.0:1788863539.971430:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863539.971465:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07480 going to sleep for 11 seconds 00000100:00100000:0.0:1788863539.971745:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445056 00000100:00100000:0.0:1788863539.971750:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445056 00000100:00100000:0.0:1788863539.971772:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788863539.971778:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226445056:12345-0@lo:501: 00000100:00100000:0.0:1788863539.971930:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226445056:12345-0@lo:501: Request processed in 142us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863539.971937:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788863539.973575:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226445056:0@lo:501: 00000100:00100000:2.0:1788863539.973701:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226445184:0@lo:503: 00000100:00100000:2.0:1788863539.973774:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863539.973821:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863539.974292:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445184 00000100:00100000:3.0:1788863539.974300:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445184 00000100:00100000:3.0:1788863539.974341:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788863539.974350:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226445184:12345-0@lo:503: 00000100:00100000:3.0:1788863539.974475:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226445184:12345-0@lo:503: Request processed in 125us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863539.974484:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788863539.974720:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226445184:0@lo:503: 00000100:00100000:2.0:1788863539.975402:0:8596:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8596:1875759226445312:0@lo:502: 00000100:00100000:2.0:1788863539.975452:0:8596:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863539.975489:0:8596:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07840 going to sleep for 11 seconds 00000100:00100000:3.0:1788863539.975715:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445312 00000100:00100000:3.0:1788863539.975721:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445312 00000100:00100000:3.0:1788863539.975801:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788863539.975810:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8596:x1875759226445312:12345-0@lo:502: 00000100:00100000:3.0:1788863539.975905:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8596:x1875759226445312:12345-0@lo:502: Request processed in 97us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863539.975912:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788863539.975995:0:8596:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8596:1875759226445312:0@lo:502: 00000020:01000000:2.0:1788863539.976029:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788863539.976037:0:8596:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788863539.976045:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863539.976048:0:8596:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788863539.976053:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788863539.976057:0:8596:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1788863539.976108:0:8596:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788863539.976111:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863539.976134:0:8596:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff89e680ddcd40) 00000020:00000080:2.0:1788863539.976169:0:8596:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788863539.976629:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788863539.976720:0:8596:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788863539.976726:0:8596:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788863539.976733:0:8596:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b68b40 00010000:00080000:2.0:1788863539.976764:0:8596:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e67aeef800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863539.976998:0:8596:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788863539.997417:0:8596:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788863539.997448:0:8596:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788863539.997708:0:8596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863539.999219:0:8596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863539.999332:0:8596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788863539.999420:0:8596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788863540.002853:0:8597:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863540.002865:0:8597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788863540.005056:0:8596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788863540.005100:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788863540.005155:0:8596:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788863540.005180:0:8596:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b68b47 00000100:00080000:3.0:1788863540.005192:0:8596:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863540.005204:0:8596:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89e67aeef800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863540.005247:0:8596:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e541ef7480 x1875759226445440/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863540.005270:0:8596:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788863540.005340:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226445440:0@lo:8: 00000100:00100000:0.0:1788863540.005422:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863540.005493:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445440 00000100:00100000:0.0:1788863540.005501:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445440 00000100:00100000:0.0:1788863540.005537:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863540.005545:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226445440:12345-0@lo:8: 00010000:00080000:0.0:1788863540.005574:0:8450:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1788863540.005604:0:8450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b68b4e 00002000:00100000:0.0:1788863540.005650:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89e5425b6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788863540.005655:0:8450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788863540.005659:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788863540.005737:0:8450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788863540.005974:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788863540.006001:0:8450:0:(import.c:65:import_set_state_nolock()) ffff89e5425b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863540.006061:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226445440:12345-0@lo:8: Request processed in 515us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.006070:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788863540.006135:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef7480 x1875759226445440/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863540.006146:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863540.006155:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788863540.006163:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788863540.006168:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788863540.006171:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67aeef800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788863540.008247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226445568:0@lo:400: 00000100:00100000:2.0:1788863540.008317:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.008354:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226446080:0@lo:400: 00000100:00100000:2.0:1788863540.008378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.008402:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863540.008408:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226445952:0@lo:400: 00000100:00100000:2.0:1788863540.008432:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.008461:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226445696:0@lo:400: 00000100:00100000:2.0:1788863540.008483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.008499:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226446208:0@lo:400: 00000100:00100000:2.0:1788863540.008522:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.008539:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863540.008545:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226445824:0@lo:400: 00000100:00100000:2.0:1788863540.008563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.008592:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445568 00000100:00100000:2.0:1788863540.008601:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445568 00000100:00100000:2.0:1788863540.008637:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446080 00000100:00100000:2.0:1788863540.008640:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446080 00000100:00100000:2.0:1788863540.008808:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446208 00000100:00100000:2.0:1788863540.008812:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446208 00000100:00100000:2.0:1788863540.008843:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445824 00000100:00100000:2.0:1788863540.008845:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445824 00000100:00100000:2.0:1788863540.008861:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863540.008869:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226445568:12345-0@lo:400: 00000100:00100000:2.0:1788863540.009057:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226445568:12345-0@lo:400: Request processed in 54us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.009066:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863540.009111:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863540.009119:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226446080:12345-0@lo:400: 00000100:00100000:2.0:1788863540.009155:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226446080:12345-0@lo:400: Request processed in 38us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.009160:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863540.009172:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863540.009177:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226446208:12345-0@lo:400: 00000100:00100000:2.0:1788863540.009206:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226446208:12345-0@lo:400: Request processed in 30us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.009212:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863540.009223:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863540.009229:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226445824:12345-0@lo:400: 00000100:00100000:2.0:1788863540.009255:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226445824:12345-0@lo:400: Request processed in 26us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.009260:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863540.009278:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445952 00000100:00100000:2.0:1788863540.009282:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445952 00000100:00100000:2.0:1788863540.009299:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226445696 00000100:00100000:2.0:1788863540.009302:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226445696 00000100:00100000:2.0:1788863540.009314:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863540.009319:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226445952:12345-0@lo:400: 00000100:00100000:2.0:1788863540.009375:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226445952:12345-0@lo:400: Request processed in 54us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.009381:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863540.009393:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863540.009399:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226445696:12345-0@lo:400: 00000100:00100000:2.0:1788863540.009426:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226445696:12345-0@lo:400: Request processed in 27us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.009431:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863540.009477:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226445952:0@lo:400: 00010000:00080000:2.0:1788863540.009491:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a9f80 x1875759226445568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.009501:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226445568:0@lo:400: 00010000:00080000:2.0:1788863540.009510:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a9c00 x1875759226446080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.009516:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226446080:0@lo:400: 00010000:00080000:2.0:1788863540.009549:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428abb80 x1875759226445824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.009557:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226445824:0@lo:400: 00000100:00100000:2.0:1788863540.009567:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226445696:0@lo:400: 00010000:00080000:2.0:1788863540.009575:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428aa300 x1875759226446208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.009582:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226446208:0@lo:400: 00000004:00080000:0.0:1788863540.015395:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788863540.015416:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226445440:0@lo:8: 00000100:00080000:0.0:1788863540.015472:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863540.015479:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1788863540.017361:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863540.017372:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863540.017375:0:8596:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788863540.017378:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863540.017383:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863540.017384:0:8596:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863540.017387:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863540.017389:0:8596:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788863540.017441:0:8596:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8596:1875759226446336:0@lo:502: 00000100:00100000:3.0:1788863540.017536:0:8596:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.017590:0:8596:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863540.018287:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226446464:0@lo:700: 00000100:00100000:1.0:1788863540.018333:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863540.018354:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c6570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.018452:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446336 00000100:00100000:0.0:1788863540.018462:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446336 00000100:00100000:0.0:1788863540.018514:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788863540.018524:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8596:x1875759226446336:12345-0@lo:502: 00000100:00100000:0.0:1788863540.018668:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:8596:x1875759226446336:12345-0@lo:502: Request processed in 144us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.018810:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788863540.019153:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446464 00000100:00100000:0.0:1788863540.019159:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446464 00000100:00100000:0.0:1788863540.019197:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863540.019204:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8599:x1875759226446464:12345-0@lo:700: 00000100:00100000:0.0:1788863540.019242:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8459:1875759226446592:0@lo:700: 00000100:00100000:0.0:1788863540.019278:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863540.019297:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6503876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.019312:0:6543:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446592 00000100:00100000:0.0:1788863540.019315:0:6543:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446592 00000100:00100000:0.0:1788863540.019341:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863540.019348:0:6543:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8459:x1875759226446592:12345-0@lo:700: 00000100:00100000:3.0:1788863540.019558:0:8596:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8596:1875759226446336:0@lo:502: 00000020:01000000:3.0:1788863540.019596:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863540.019604:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863540.019606:0:8596:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788863540.019611:0:8596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1788863540.020103:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788863540.020125:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788863540.020136:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.020149:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863540.020158:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788863540.020161:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e64a89a800 from 30 10000000:01000000:3.0:1788863540.020164:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788863540.020193:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.020201:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.020210:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863540.020226:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226446720:0@lo:101: 00000100:00100000:3.0:1788863540.020266:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.020286:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863540.020301:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446720 00000100:00100000:3.0:1788863540.020306:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446720 00000100:00100000:3.0:1788863540.020347:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788863540.020353:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226446720:12345-0@lo:101: 00010000:00010000:3.0:1788863540.020363:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863540.020375:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68b55 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.020398:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.020409:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.020418:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167c200, rc 0) 00000100:00100000:3.0:1788863540.020453:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226446720:12345-0@lo:101: Request processed in 99us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863540.020459:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788863540.020498:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226446720:0@lo:101: 00010000:00010000:3.0:1788863540.020511:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.020519:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863540.020570:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226446848:0@lo:501: 00000100:00100000:3.0:1788863540.020595:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.020609:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.020816:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446848 00000100:00100000:0.0:1788863540.020822:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446848 00000100:00100000:0.0:1788863540.020848:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788863540.020855:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226446848:12345-0@lo:501: 00000100:00080000:1.0:1788863540.021110:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863540.021172:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226446848:12345-0@lo:501: Request processed in 317us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.021190:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788863540.021759:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226446848:0@lo:501: 00000100:00100000:3.0:1788863540.021812:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226446976:0@lo:503: 00000100:00100000:3.0:1788863540.021862:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.021887:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863540.021900:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226446976 00000100:00100000:3.0:1788863540.021905:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226446976 00000100:00100000:3.0:1788863540.021932:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788863540.021940:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226446976:12345-0@lo:503: 00000100:00100000:3.0:1788863540.022043:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226446976:12345-0@lo:503: Request processed in 104us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863540.022050:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788863540.022108:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226446976:0@lo:503: 00000100:00100000:3.0:1788863540.022286:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8600:1875759226447104:0@lo:502: 00000100:00100000:3.0:1788863540.022320:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.022335:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541089780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.022473:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226447104 00000100:00100000:0.0:1788863540.022478:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226447104 00000100:00100000:0.0:1788863540.022508:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788863540.022514:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8600:x1875759226447104:12345-0@lo:502: 00000100:00100000:0.0:1788863540.022592:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8600:x1875759226447104:12345-0@lo:502: Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.022599:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:2.0:1788863540.022964:0:8597:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788863540.023057:0:8597:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 207146979835ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788863540.023064:0:8597:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788863540.023585:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8600:1875759226447104:0@lo:502: 00000100:00100000:3.0:1788863540.023781:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8600:1875759226447232:0@lo:502: 00000100:00100000:3.0:1788863540.023842:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.023938:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554ba80 going to sleep for 11 seconds 00000004:00080000:0.0:1788863540.026348:0:7467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788863540.026583:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226447232 00000100:00100000:2.0:1788863540.026594:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226447232 00000100:00100000:2.0:1788863540.029445:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788863540.029464:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8600:x1875759226447232:12345-0@lo:502: 00000100:00100000:2.0:1788863540.029658:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:8600:x1875759226447232:12345-0@lo:502: Request processed in 201us (5815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.029667:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788863540.030018:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8600:1875759226447232:0@lo:502: 00000040:00080000:3.0:1788863540.030186:0:8600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788863540.030426:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788863540.030450:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863540.030461:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.030472:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863540.030481:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863540.030483:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e64a89a800 from 5 10000000:01000000:2.0:1788863540.030486:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863540.030525:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.030533:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.030542:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863540.030563:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447360:0@lo:101: 00000100:00100000:2.0:1788863540.030615:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.030657:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863540.030843:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226447360 00000100:00100000:3.0:1788863540.030851:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226447360 00000100:00100000:3.0:1788863540.030894:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788863540.030902:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226447360:12345-0@lo:101: 00010000:00010000:3.0:1788863540.030913:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863540.030936:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68b63 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.030967:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.030984:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.030994:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167da00, rc 0) 00000100:00100000:3.0:1788863540.031028:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226447360:12345-0@lo:101: Request processed in 127us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863540.031034:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788863540.031178:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447360:0@lo:101: 00010000:00010000:2.0:1788863540.031191:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.031200:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863540.031252:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447488:0@lo:256: 00000100:00100000:2.0:1788863540.031285:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.031311:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863540.031382:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226447488 00000100:00100000:3.0:1788863540.031387:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226447488 00000100:00100000:3.0:1788863540.031409:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788863540.031414:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226447488:12345-0@lo:256: 20000000:01000000:3.0:1788863540.031427:0:6532:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788863540.031443:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788863540.031446:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788863540.031521:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226447488:12345-0@lo:256: Request processed in 106us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863540.031528:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788863540.031591:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447488:0@lo:256: 10000000:01000000:2.0:1788863540.031647:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863540.031653:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.031660:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863540.031666:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788863540.031668:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788863540.031671:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788863540.031696:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.031703:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.031720:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863540.031731:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447616:0@lo:101: 00000100:00100000:2.0:1788863540.031754:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.031775:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863540.031799:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226447616 00000100:00100000:2.0:1788863540.031803:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226447616 00000100:00100000:2.0:1788863540.031825:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788863540.031831:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226447616:12345-0@lo:101: 00010000:00010000:2.0:1788863540.031838:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863540.031846:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68b71 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.031859:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.031867:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.031873:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537000, rc 0) 00000100:00100000:2.0:1788863540.031899:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226447616:12345-0@lo:101: Request processed in 68us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.031904:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788863540.032294:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447616:0@lo:101: 00010000:00010000:2.0:1788863540.032310:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.032328:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863540.032382:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447744:0@lo:501: 00000100:00100000:2.0:1788863540.032410:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.032431:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863540.032442:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226447744 00000100:00100000:2.0:1788863540.032446:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226447744 00000100:00100000:2.0:1788863540.032467:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788863540.032473:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226447744:12345-0@lo:501: 00000100:00100000:2.0:1788863540.032581:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226447744:12345-0@lo:501: Request processed in 108us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.032587:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788863540.032618:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447744:0@lo:501: 00000100:00100000:2.0:1788863540.032656:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447872:0@lo:503: 00000100:00100000:2.0:1788863540.032705:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.032718:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863540.032729:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226447872 00000100:00100000:2.0:1788863540.032733:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226447872 00000100:00100000:2.0:1788863540.032752:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863540.032757:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226447872:12345-0@lo:503: 00000100:00100000:2.0:1788863540.032839:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226447872:12345-0@lo:503: Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.032845:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863540.032882:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226447872:0@lo:503: 00000100:00100000:1.0:1788863540.033282:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8601:1875759226448000:0@lo:502: 00000100:00100000:1.0:1788863540.033321:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863540.033352:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c657540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863540.033482:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448000 00000100:00100000:2.0:1788863540.033488:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448000 00000100:00100000:2.0:1788863540.033512:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788863540.033519:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:8601:x1875759226448000:12345-0@lo:502: 00000100:00100000:2.0:1788863540.033604:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:8601:x1875759226448000:12345-0@lo:502: Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.033610:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788863540.033766:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8601:1875759226448000:0@lo:502: 00000020:01000000:1.0:1788863540.033801:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788863540.033810:0:8601:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788863540.033818:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863540.033820:0:8601:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788863540.033829:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788863540.033833:0:8601:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1788863540.033854:0:8601:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788863540.033857:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863540.033873:0:8601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89e6763c3380) 00000020:00000080:1.0:1788863540.033894:0:8601:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788863540.033899:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788863540.033993:0:8601:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788863540.033999:0:8601:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788863540.034012:0:8601:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b68b86 00010000:00080000:1.0:1788863540.034044:0:8601:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e676347800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788863540.034301:0:8601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:0.0:1788863540.034894:0:6543:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788863540.042049:0:6543:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8459:x1875759226446592:12345-0@lo:700: Request processed in 22692us (22760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.042071:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788863540.042364:0:8459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e6712a8000 x1875759226446592/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863540.042382:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8459:1875759226446592:0@lo:700: 40000000:02000000:0.0:1788863540.042395:0:8459:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1788863540.045654:0:8601:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788863540.045682:0:8601:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788863540.045913:0:8601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863540.046519:0:8601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863540.046613:0:8601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788863540.046702:0:8601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788863540.055231:0:8602:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863540.055243:0:8602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:2.0:1788863540.058493:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788863540.058701:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8599:x1875759226446464:12345-0@lo:700: Request processed in 39491us (40361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863540.058740:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788863540.058905:0:8599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e66d4b8380 x1875759226446464/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.059003:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226446464:0@lo:700: 00000004:00080000:3.0:1788863540.071246:0:8599:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788863540.071286:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226448256:0@lo:7: 00000100:00100000:3.0:1788863540.071378:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.071427:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541089780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863540.071455:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448256 00000100:00100000:3.0:1788863540.071464:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448256 00000100:00100000:3.0:1788863540.071523:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863540.071533:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8599:x1875759226448256:12345-0@lo:7: 00000100:00100000:2.0:1788863540.072973:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226448128:0@lo:13: 00000100:00100000:2.0:1788863540.073029:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863540.075114:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448128 00000100:00100000:0.0:1788863540.075128:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448128 00000100:00100000:0.0:1788863540.075193:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863540.075203:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226448128:12345-0@lo:13: 00002000:00000024:0.0:1788863540.076026:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:0.0:1788863540.076132:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226448128:12345-0@lo:13: Request processed in 928us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.076139:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788863540.076361:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef4a80 x1875759226448128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.076385:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226448128:0@lo:13: 00000020:00000080:0.0:1788863540.078164:0:8601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788863540.078179:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788863540.080094:0:8601:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788863540.080129:0:8601:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b68b8d 00000100:00080000:0.0:1788863540.080150:0:8601:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788863540.080163:0:8601:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e676347800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863540.080560:0:8601:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e6712a8000 x1875759226448384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863540.080596:0:8601:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788863540.081180:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863540.081188:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863540.081190:0:8601:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788863540.081194:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863540.081198:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863540.081199:0:8601:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788863540.081202:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863540.081204:0:8601:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788863540.081596:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8601:1875759226448512:0@lo:502: 00000100:00100000:2.0:1788863540.081813:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226448384:0@lo:8: 00000100:00100000:2.0:1788863540.081857:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.081940:0:8451:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788863540.081948:0:8451:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788863540.082366:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863540.082396:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448512 00000100:00100000:0.0:1788863540.082403:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448512 00000100:00100000:0.0:1788863540.082449:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788863540.082457:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:8601:x1875759226448512:12345-0@lo:502: 00000100:00100000:0.0:1788863540.082584:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:8601:x1875759226448512:12345-0@lo:502: Request processed in 127us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.082592:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788863540.082635:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e650387840 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.082658:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:8601:1875759226448512:0@lo:502: 00000020:01000000:0.0:1788863540.084132:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863540.084143:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863540.084146:0:8601:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788863540.084153:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:3.0:1788863540.086338:0:8452:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788863540.086347:0:8452:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788863540.086454:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8599:x1875759226448256:12345-0@lo:7: Request processed in 14918us (15072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863540.086467:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788863540.086527:0:8599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef5f80 x1875759226448256/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863540.086543:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226448256:0@lo:7: 00000004:00080000:3.0:1788863540.086558:0:8599:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788863540.086602:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226448640:0@lo:5: 00000100:00100000:3.0:1788863540.086634:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.086664:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541089780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863540.086697:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448384 00000100:00100000:3.0:1788863540.086704:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448384 00000100:00100000:3.0:1788863540.086723:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448640 00000100:00100000:3.0:1788863540.086725:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448640 00000100:00100000:3.0:1788863540.086746:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863540.086752:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226448384:12345-0@lo:8: 00010000:00080000:3.0:1788863540.086780:0:8452:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:3.0:1788863540.086824:0:8452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b68b94 00002000:00100000:3.0:1788863540.086839:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89e5425c8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788863540.086849:0:8452:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788863540.086852:0:8452:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788863540.086898:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788863540.087121:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788863540.087133:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8599:x1875759226448640:12345-0@lo:5: 00002000:00080000:0.0:1788863540.087155:0:8606:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788863540.087187:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8599:x1875759226448640:12345-0@lo:5: Request processed in 56us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.087193:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788863540.087218:0:8599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef5f80 x1875759226448640/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863540.087228:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226448640:0@lo:5: 00000004:00080000:0.0:1788863540.087236:0:8599:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788863540.087262:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226448768:0@lo:5: 00000100:00100000:0.0:1788863540.087286:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863540.087301:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.087311:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448768 00000100:00100000:0.0:1788863540.087315:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448768 00000100:00100000:0.0:1788863540.087337:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863540.087343:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8599:x1875759226448768:12345-0@lo:5: 00002000:00080000:0.0:1788863540.087366:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788863540.089799:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8599:x1875759226448768:12345-0@lo:5: Request processed in 2438us (2494us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788863540.089810:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788863540.089919:0:8599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e6712a9500 x1875759226448768/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863540.089937:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8599:1875759226448768:0@lo:5: 00000004:00080000:0.0:1788863540.089951:0:8599:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788863540.090010:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8599:1875759226448896:0@lo:900: 00000100:00100000:0.0:1788863540.090061:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863540.090103:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.090129:0:6548:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226448896 00000100:00100000:0.0:1788863540.090136:0:6548:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226448896 00000100:00100000:0.0:1788863540.090173:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863540.090182:0:6548:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8599:x1875759226448896:12345-0@lo:900: 00000100:00100000:0.0:1788863540.091147:0:6548:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8599:x1875759226448896:12345-0@lo:900: Request processed in 963us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.091155:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788863540.091192:0:8599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e6712a9c00 x1875759226448896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863540.091203:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8599:1875759226448896:0@lo:900: 00000100:00080000:3.0:1788863540.091424:0:8452:0:(import.c:65:import_set_state_nolock()) ffff89e5425ce000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863540.091476:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226448384:12345-0@lo:8: Request processed in 4723us (9618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863540.091485:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1788863540.091621:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788863540.091651:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788863540.091662:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.091740:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788863540.091800:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e6712a8000 x1875759226448384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.091808:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788863540.091816:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788863540.091824:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788863540.091829:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788863540.091832:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676347800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788863540.094454:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788863540.094473:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226448384:0@lo:8: 10000000:01000000:2.0:1788863540.094514:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788863540.094518:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89e671354d40 from 1 10000000:01000000:2.0:1788863540.094521:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788863540.094583:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.094594:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.094605:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863540.094628:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226449024:0@lo:101: 00000100:00100000:2.0:1788863540.095799:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863540.095857:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449024 00000100:00100000:2.0:1788863540.095874:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449024 00000100:00100000:2.0:1788863540.096041:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788863540.096051:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226449024:12345-0@lo:101: 00010000:00010000:2.0:1788863540.096071:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863540.096104:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68b9b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.096135:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.096148:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863540.096157:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98000, rc 0) 00000100:00100000:2.0:1788863540.096201:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226449024:12345-0@lo:101: Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.096219:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000004:00080000:3.0:1788863540.096473:0:8602:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788863540.097314:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863540.097348:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226449024:0@lo:101: 00010000:00010000:3.0:1788863540.097372:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.097382:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863540.097499:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226449152:0@lo:501: 00000100:00100000:3.0:1788863540.097551:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.098855:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541089780 going to sleep for 11 seconds 00000004:00080000:3.0:1788863540.098918:0:8602:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 207222840750ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788863540.099472:0:8602:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788863540.100892:0:8603:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788863540.101064:0:8603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449408:0@lo:7: 00000100:00100000:3.0:1788863540.101154:0:8603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.101181:0:8603:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae14540 going to sleep for 11 seconds 00000004:00080000:3.0:1788863540.101593:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788863540.101770:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226449280:0@lo:13: 00000100:00100000:3.0:1788863540.101825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863540.102008:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449152 00000100:00100000:0.0:1788863540.102017:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449152 00000100:00100000:0.0:1788863540.102058:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863540.102066:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226449152:12345-0@lo:501: 00000100:00100000:0.0:1788863540.102178:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226449152:12345-0@lo:501: Request processed in 112us (4627us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863540.102186:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863540.102232:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449408 00000100:00100000:0.0:1788863540.102236:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449408 00000100:00100000:0.0:1788863540.102271:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863540.102277:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8603:x1875759226449408:12345-0@lo:7: 00000100:00080000:1.0:1788863540.103967:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863540.105464:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226449152:0@lo:501: 10000000:01000000:3.0:1788863540.105528:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788863540.105540:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863540.105551:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863540.110148:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449280 00000100:00100000:2.0:1788863540.110165:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449280 00000100:00100000:2.0:1788863540.110390:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863540.110403:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226449280:12345-0@lo:13: 00002000:00000024:2.0:1788863540.110431:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788863540.110524:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226449280:12345-0@lo:13: Request processed in 125us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863540.110530:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788863540.110583:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef5c00 x1875759226449280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.110606:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226449280:0@lo:13: 00002000:00080000:0.0:1788863540.112166:0:8450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788863540.112174:0:8450:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788863540.112396:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8603:x1875759226449408:12345-0@lo:7: Request processed in 10115us (11238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863540.112415:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788863540.112508:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef6300 x1875759226449408/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863540.112657:0:8603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449408:0@lo:7: 00000004:00080000:3.0:1788863540.112673:0:8603:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788863540.112800:0:8603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449536:0@lo:5: 00000100:00100000:3.0:1788863540.112839:0:8603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.112878:0:8603:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae14540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.113018:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449536 00000100:00100000:0.0:1788863540.113027:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449536 00000100:00100000:0.0:1788863540.113142:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863540.113153:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8603:x1875759226449536:12345-0@lo:5: 00002000:00080000:0.0:1788863540.113180:0:8452:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788863540.113183:0:8452:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788863540.124201:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1788863540.124350:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788863540.124356:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788863540.126338:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8603:x1875759226449536:12345-0@lo:5: Request processed in 13180us (13492us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788863540.126352:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788863540.126810:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef6300 x1875759226449536/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863540.126823:0:8603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788863540.126831:0:8603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449536:0@lo:5: 00000004:00080000:3.0:1788863540.128086:0:8603:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788863540.128154:0:8603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449664:0@lo:700: 00000100:00100000:3.0:1788863540.128236:0:8603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.128277:0:8603:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae14540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863540.128837:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449664 00000100:00100000:1.0:1788863540.128847:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449664 00000100:00100000:1.0:1788863540.129112:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863540.129122:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8603:x1875759226449664:12345-0@lo:700: 00000100:00100000:1.0:1788863540.151572:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8603:x1875759226449664:12345-0@lo:700: Request processed in 22439us (23326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863540.151590:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788863540.159146:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef6300 x1875759226449664/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863540.159179:0:8603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449664:0@lo:700: 00000004:02000040:3.0:1788863540.174043:0:8603:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788863540.185205:0:8603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449792:0@lo:5: 00000100:00100000:3.0:1788863540.185285:0:8603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863540.185355:0:8603:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae14540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863540.185639:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449792 00000100:00100000:0.0:1788863540.185650:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449792 00000100:00100000:0.0:1788863540.185733:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863540.185743:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8603:x1875759226449792:12345-0@lo:5: 00002000:00080000:0.0:1788863540.194979:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788863540.195000:0:8451:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788863540.197940:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8603:x1875759226449792:12345-0@lo:5: Request processed in 12191us (12647us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788863540.197956:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788863540.206148:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef6300 x1875759226449792/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863556 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863540.206173:0:8603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8603:1875759226449792:0@lo:5: 00000004:00080000:2.0:1788863540.206190:0:8603:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1788863540.395291:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863541.420202:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863541.739463:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226449920:0@lo:41: 00000100:00100000:1.0:1788863541.739611:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226450048:0@lo:41: 00000100:00100000:1.0:1788863541.739706:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863541.739824:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450048 00000100:00100000:1.0:1788863541.739833:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450048 00000100:00100000:1.0:1788863541.739889:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863541.739900:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226450048:12345-0@lo:41: 00000004:00000024:1.0:1788863541.739944:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788863541.740000:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226450048:12345-0@lo:41: Request processed in 102us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863541.740007:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863541.740063:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226450048:0@lo:41: 00000100:00100000:3.0:1788863541.740875:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863541.741201:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226449920 00000100:00100000:0.0:1788863541.741212:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226449920 00000100:00100000:0.0:1788863541.741269:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863541.741279:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226449920:12345-0@lo:41: 00000004:00000024:0.0:1788863541.741316:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788863541.741375:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226449920:12345-0@lo:41: Request processed in 99us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863541.741382:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863541.741443:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226449920:0@lo:41: 00010000:00010000:2.0:1788863542.443490:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863543.467656:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863544.220236:0:8826:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788863544.499227:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788863545.154239:0:8879:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863545.154434:0:8879:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788863545.340753:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226450176:0@lo:13: 00000100:00100000:0.0:1788863545.340845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.340916:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226450688:0@lo:400: 00000100:00100000:2.0:1788863545.341227:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450176 00000100:00100000:2.0:1788863545.341237:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450176 00000100:00100000:2.0:1788863545.341299:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863545.341308:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226450176:12345-0@lo:13: 00002000:00000024:2.0:1788863545.341339:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863545.351905:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226450176:12345-0@lo:13: Request processed in 10585us (11047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.351936:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788863545.351995:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863545.352529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.352610:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226451200:0@lo:400: 00000100:00100000:0.0:1788863545.352651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788863545.352724:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681ca8700 x1875759226450176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863545.352750:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226450176:0@lo:13: 00000100:00100000:0.0:1788863545.352773:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788863545.352780:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226450560:0@lo:400: 00000100:00100000:0.0:1788863545.352803:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.352823:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226451072:0@lo:400: 00000100:00100000:0.0:1788863545.352842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.352872:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226450304:0@lo:13: 00000100:00100000:0.0:1788863545.352895:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.352917:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226450816:0@lo:400: 00000100:00100000:0.0:1788863545.352937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.352948:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226451328:0@lo:400: 00000100:00100000:0.0:1788863545.352969:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.352984:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788863545.352990:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226450432:0@lo:400: 00000100:00100000:0.0:1788863545.353014:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.353056:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226450944:0@lo:400: 00000100:00100000:0.0:1788863545.354219:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863545.354271:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226451456:0@lo:400: 00000100:00100000:0.0:1788863545.354326:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863545.354494:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450688 00000100:00100000:2.0:1788863545.354505:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450688 00000100:00100000:2.0:1788863545.354545:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450944 00000100:00100000:2.0:1788863545.354548:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450944 00000100:00100000:2.0:1788863545.354564:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788863545.354585:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226450688:12345-0@lo:400: 00000100:00100000:2.0:1788863545.354652:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226450688:12345-0@lo:400: Request processed in 79us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.354659:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788863545.354700:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788863545.354707:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226450944:12345-0@lo:400: 00000100:00100000:2.0:1788863545.354743:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226450944:12345-0@lo:400: Request processed in 37us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.354748:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788863545.354767:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451328 00000100:00100000:2.0:1788863545.354770:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451328 00000100:00100000:2.0:1788863545.354808:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451456 00000100:00100000:2.0:1788863545.354811:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451456 00000100:00100000:2.0:1788863545.354832:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863545.354837:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226451328:12345-0@lo:400: 00000100:00100000:2.0:1788863545.354870:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226451328:12345-0@lo:400: Request processed in 32us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.354876:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863545.354887:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863545.354893:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226451456:12345-0@lo:400: 00000100:00100000:2.0:1788863545.354918:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226451456:12345-0@lo:400: Request processed in 25us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.354923:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788863545.354941:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863545.364229:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450432 00000100:00100000:2.0:1788863545.364248:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450432 00000100:00100000:2.0:1788863545.364322:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788863545.364343:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3642:x1875759226450432:12345-0@lo:400: 00000100:00100000:2.0:1788863545.364461:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3642:x1875759226450432:12345-0@lo:400: Request processed in 131us (11446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.364469:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788863545.364526:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451200 00000100:00100000:2.0:1788863545.364530:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451200 00000100:00100000:2.0:1788863545.364561:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450560 00000100:00100000:2.0:1788863545.364564:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450560 00000100:00100000:2.0:1788863545.364575:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451072 00000100:00100000:2.0:1788863545.364577:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451072 00000100:00100000:0.0:1788863545.364585:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226450688:0@lo:400: 00000100:00100000:2.0:1788863545.364589:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450816 00000100:00100000:2.0:1788863545.364591:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450816 00000100:00100000:2.0:1788863545.364604:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863545.364610:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226451200:12345-0@lo:400: 00000100:00100000:0.0:1788863545.364620:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226450432:0@lo:400: 00000100:00100000:0.0:1788863545.364633:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226450944:0@lo:400: 00000100:00100000:2.0:1788863545.364647:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226451200:12345-0@lo:400: Request processed in 38us (11996us total) trans 0 rc 0/0 00010000:00080000:0.0:1788863545.364648:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681caad80 x1875759226451456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863545.364653:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863545.364659:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226451456:0@lo:400: 00000100:00100000:2.0:1788863545.364665:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863545.364670:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226450560:12345-0@lo:400: 00010000:00080000:0.0:1788863545.364672:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681ca8380 x1875759226451328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863545.364680:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788863545.364703:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226451328:0@lo:400: 00000100:00100000:2.0:1788863545.364716:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226450560:12345-0@lo:400: Request processed in 46us (11913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.364722:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863545.364732:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863545.364737:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226451072:12345-0@lo:400: 00010000:00080000:0.0:1788863545.364760:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681ca9c00 x1875759226450560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863545.364763:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226451072:12345-0@lo:400: Request processed in 26us (11920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.364769:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863545.364771:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226450560:0@lo:400: 00000100:00100000:2.0:1788863545.364779:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788863545.364781:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681cab800 x1875759226451072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863545.364784:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226450816:12345-0@lo:400: 00000100:00100000:0.0:1788863545.364790:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226451072:0@lo:400: 00010000:00080000:0.0:1788863545.364799:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681ca8a80 x1875759226451200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863545.364807:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226451200:0@lo:400: 00000100:00100000:2.0:1788863545.364812:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226450816:12345-0@lo:400: Request processed in 28us (11874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.364817:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788863545.364845:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681ca9880 x1875759226450816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788863545.364846:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863545.364850:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863545.364853:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226450816:0@lo:400: 00000100:00100000:2.0:1788863545.364874:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226450304 00000100:00100000:2.0:1788863545.364877:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226450304 00000100:00100000:2.0:1788863545.364903:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863545.364910:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226450304:12345-0@lo:13: 00002000:00000024:2.0:1788863545.364927:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863545.364972:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226450304:12345-0@lo:13: Request processed in 63us (12076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863545.364978:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788863545.365057:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681cabb80 x1875759226450304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863545.365073:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226450304:0@lo:13: 00010000:00010000:1.0:1788863545.515438:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788863545.841562:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1788863546.539413:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863546.860838:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226451584:0@lo:41: 00000100:00100000:1.0:1788863546.860965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863546.861611:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863546.861625:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226451712:0@lo:41: 00000100:00100000:1.0:1788863546.861677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863546.861772:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451584 00000100:00100000:3.0:1788863546.861793:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451584 00000100:00100000:3.0:1788863546.861842:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451712 00000100:00100000:3.0:1788863546.861846:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451712 00000100:00100000:3.0:1788863546.861865:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788863546.861876:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226451584:12345-0@lo:41: 00000004:00000024:3.0:1788863546.861930:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788863546.861997:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226451584:12345-0@lo:41: Request processed in 122us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863546.862005:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788863546.862024:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788863546.862031:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226451712:12345-0@lo:41: 00000004:00000024:3.0:1788863546.862050:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788863546.862109:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226451712:12345-0@lo:41: Request processed in 79us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863546.862116:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863546.862393:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226451712:0@lo:41: 00000100:00100000:1.0:1788863546.862409:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226451584:0@lo:41: 00010000:00010000:1.0:1788863547.567134:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788863548.006363:0:8980:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863548.006599:0:8980:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863548.597137:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863549.030916:0:9028:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863549.030929:0:9028:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788863549.611338:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863550.443389:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226451840:0@lo:13: 00000100:00100000:0.0:1788863550.443490:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.443569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226452352:0@lo:400: 00000100:00100000:0.0:1788863550.443610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.443628:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226452864:0@lo:400: 00000100:00100000:0.0:1788863550.443655:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.443682:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788863550.443689:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226451968:0@lo:400: 00000100:00100000:0.0:1788863550.443721:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.443743:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226452480:0@lo:400: 00000100:00100000:0.0:1788863550.443802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.443821:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226452992:0@lo:400: 00000100:00100000:0.0:1788863550.443843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.443880:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451840 00000100:00100000:0.0:1788863550.443891:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451840 00000100:00100000:0.0:1788863550.443967:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863550.443978:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226451840:12345-0@lo:13: 00002000:00000024:0.0:1788863550.444017:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863550.444070:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226451840:12345-0@lo:13: Request processed in 94us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863550.444107:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863550.444136:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452480 00000100:00100000:0.0:1788863550.444140:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452480 00000100:00100000:0.0:1788863550.444170:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788863550.444177:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226452480:12345-0@lo:400: 00000100:00100000:0.0:1788863550.444216:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226452480:12345-0@lo:400: Request processed in 40us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863550.444223:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788863550.444269:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226452480:0@lo:400: 00010000:00080000:0.0:1788863550.444285:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2ca80 x1875759226451840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863550.444303:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226451840:0@lo:13: 00000100:00100000:0.0:1788863550.444350:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226452096:0@lo:400: 00000100:00100000:0.0:1788863550.444379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.444397:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226452608:0@lo:400: 00000100:00100000:0.0:1788863550.444418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.444435:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788863550.444442:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226452224:0@lo:400: 00000100:00100000:0.0:1788863550.444464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.444481:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226452736:0@lo:400: 00000100:00100000:0.0:1788863550.444516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863550.444535:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452224 00000100:00100000:0.0:1788863550.444539:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452224 00000100:00100000:0.0:1788863550.444562:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788863550.444569:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226452224:12345-0@lo:400: 00000100:00100000:0.0:1788863550.444620:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226452224:12345-0@lo:400: Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863550.444626:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788863550.444653:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226452224:0@lo:400: 00000100:00100000:2.0:1788863550.444889:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863550.444900:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226453120:0@lo:13: 00000100:00100000:2.0:1788863550.444933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863550.444966:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452352 00000100:00100000:2.0:1788863550.444970:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452352 00000100:00100000:2.0:1788863550.444997:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452096 00000100:00100000:2.0:1788863550.445000:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452096 00000100:00100000:2.0:1788863550.445012:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452608 00000100:00100000:2.0:1788863550.445014:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452608 00000100:00100000:2.0:1788863550.445030:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452736 00000100:00100000:2.0:1788863550.445032:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452736 00000100:00100000:2.0:1788863550.445048:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788863550.445055:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226452352:12345-0@lo:400: 00000100:00100000:2.0:1788863550.445132:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226452352:12345-0@lo:400: Request processed in 76us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445139:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788863550.445153:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788863550.445159:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226452096:12345-0@lo:400: 00000100:00100000:2.0:1788863550.445201:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226452096:12345-0@lo:400: Request processed in 42us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445208:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788863550.445221:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788863550.445227:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226452608:12345-0@lo:400: 00000100:00100000:2.0:1788863550.445252:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226452608:12345-0@lo:400: Request processed in 26us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445257:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788863550.445268:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788863550.445274:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226452736:12345-0@lo:400: 00000100:00100000:2.0:1788863550.445300:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226452736:12345-0@lo:400: Request processed in 26us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445306:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788863550.445327:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452864 00000100:00100000:2.0:1788863550.445331:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452864 00000100:00100000:2.0:1788863550.445357:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226452992 00000100:00100000:2.0:1788863550.445360:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226452992 00000100:00100000:2.0:1788863550.445398:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863550.445404:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226452864:12345-0@lo:400: 00000100:00100000:2.0:1788863550.445435:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226452864:12345-0@lo:400: Request processed in 32us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445442:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863550.445453:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863550.445459:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226452992:12345-0@lo:400: 00000100:00100000:2.0:1788863550.445485:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226452992:12345-0@lo:400: Request processed in 27us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445500:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863550.445522:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226451968 00000100:00100000:2.0:1788863550.445526:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226451968 00000100:00100000:2.0:1788863550.445554:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788863550.445561:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3642:x1875759226451968:12345-0@lo:400: 00000100:00100000:2.0:1788863550.445604:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3642:x1875759226451968:12345-0@lo:400: Request processed in 44us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445610:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788863550.445644:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863550.445649:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863550.445652:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863550.445663:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226453120 00000100:00100000:2.0:1788863550.445666:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226453120 00000100:00100000:2.0:1788863550.445685:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863550.445692:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226453120:12345-0@lo:13: 00002000:00000024:2.0:1788863550.445707:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863550.445743:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226453120:12345-0@lo:13: Request processed in 51us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863550.445749:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788863550.445802:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a9c00 x1875759226453120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863550.445813:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788863550.445833:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226453120:0@lo:13: 00000100:00100000:2.0:1788863550.445867:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226451968:0@lo:400: 00010000:00080000:2.0:1788863550.445879:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2df80 x1875759226452992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863550.445903:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226452992:0@lo:400: 00010000:00080000:2.0:1788863550.445919:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2e680 x1875759226452352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863550.445928:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226452352:0@lo:400: 00010000:00080000:2.0:1788863550.445939:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2f100 x1875759226452864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863550.445948:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226452864:0@lo:400: 00010000:00080000:0.0:1788863550.447618:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2d500 x1875759226452736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863550.447636:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226452736:0@lo:400: 00010000:00080000:0.0:1788863550.447652:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2ed80 x1875759226452096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863550.447660:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226452096:0@lo:400: 00010000:00080000:0.0:1788863550.447672:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2d180 x1875759226452608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863550.447679:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226452608:0@lo:400: 00010000:00010000:1.0:1788863550.637149:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863551.660938:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863551.979322:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226453248:0@lo:41: 00000100:00100000:0.0:1788863551.979433:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863551.979583:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226453248 00000100:00100000:1.0:1788863551.979597:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226453248 00000100:00100000:1.0:1788863551.979661:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788863551.979671:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226453248:12345-0@lo:41: 00000004:00000024:1.0:1788863551.979717:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788863551.979773:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226453248:12345-0@lo:41: Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863551.979780:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788863551.979872:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226453248:0@lo:41: 00000100:00100000:1.0:1788863551.980112:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226453376:0@lo:41: 00000100:00100000:1.0:1788863551.980149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863551.980288:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226453376 00000100:00100000:2.0:1788863551.980294:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226453376 00000100:00100000:2.0:1788863551.980329:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863551.980335:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226453376:12345-0@lo:41: 00000004:00000024:2.0:1788863551.980357:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788863551.980410:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226453376:12345-0@lo:41: Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863551.980416:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863551.980541:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226453376:0@lo:41: 00010000:00010000:0.0:1788863552.684211:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863553.709111:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863554.734438:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863555.564320:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226453504:0@lo:13: 00000100:00100000:0.0:1788863555.564420:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.564744:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226453504 00000100:00100000:0.0:1788863555.564754:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226453504 00000100:00100000:0.0:1788863555.564819:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863555.564830:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226453504:12345-0@lo:13: 00002000:00000024:0.0:1788863555.564868:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863555.564918:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226453504:12345-0@lo:13: Request processed in 90us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.564926:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863555.564954:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226453632:0@lo:400: 00000100:00100000:0.0:1788863555.564990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.565015:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226454144:0@lo:400: 00000100:00100000:0.0:1788863555.565041:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.565061:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226454656:0@lo:400: 00000100:00100000:0.0:1788863555.565107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.565130:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788863555.565135:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226453760:0@lo:13: 00000100:00100000:0.0:1788863555.565156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.565169:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226454272:0@lo:400: 00000100:00100000:0.0:1788863555.565191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.565224:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226454016:0@lo:400: 00000100:00100000:0.0:1788863555.565247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.565263:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226454528:0@lo:400: 00000100:00100000:0.0:1788863555.565283:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788863555.565318:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a8e00 x1875759226453504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863555.565355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226453504:0@lo:13: 00000100:00100000:0.0:1788863555.565376:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788863555.565381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226453888:0@lo:400: 00000100:00100000:0.0:1788863555.565406:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863555.565425:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226454400:0@lo:400: 00000100:00100000:0.0:1788863555.565446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788863555.565466:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863555.565479:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226453760 00000100:00100000:0.0:1788863555.565494:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226453760 00000100:00100000:0.0:1788863555.565525:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863555.565531:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226453760:12345-0@lo:13: 00002000:00000024:0.0:1788863555.565542:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863555.565909:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226453760:12345-0@lo:13: Request processed in 377us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.565917:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863555.565943:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226453632 00000100:00100000:0.0:1788863555.565948:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226453632 00000100:00100000:0.0:1788863555.565976:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788863555.565983:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3640:x1875759226453632:12345-0@lo:400: 00000100:00100000:0.0:1788863555.566016:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3640:x1875759226453632:12345-0@lo:400: Request processed in 33us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.566023:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788863555.566055:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454144 00000100:00100000:0.0:1788863555.566059:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454144 00000100:00100000:0.0:1788863555.566114:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454528 00000100:00100000:0.0:1788863555.566118:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454528 00000100:00100000:0.0:1788863555.566146:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226453888 00000100:00100000:0.0:1788863555.566149:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226453888 00000100:00100000:0.0:1788863555.566162:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454400 00000100:00100000:0.0:1788863555.566165:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454400 00000100:00100000:0.0:1788863555.566180:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863555.566187:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226454144:12345-0@lo:400: 00000100:00100000:0.0:1788863555.566221:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226454144:12345-0@lo:400: Request processed in 34us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.566228:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863555.566242:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863555.566249:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226454528:12345-0@lo:400: 00000100:00100000:0.0:1788863555.566281:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226454528:12345-0@lo:400: Request processed in 33us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.566287:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863555.566299:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863555.566304:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226453888:12345-0@lo:400: 00000100:00100000:0.0:1788863555.566330:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226453888:12345-0@lo:400: Request processed in 27us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.566336:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863555.566348:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863555.566355:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226454400:12345-0@lo:400: 00000100:00100000:0.0:1788863555.566381:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226454400:12345-0@lo:400: Request processed in 28us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.566386:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863555.566407:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454656 00000100:00100000:0.0:1788863555.566410:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454656 00000100:00100000:0.0:1788863555.566438:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863555.566444:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226454656:12345-0@lo:400: 00000100:00100000:0.0:1788863555.566498:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226454656:12345-0@lo:400: Request processed in 53us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.566505:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863555.566528:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454272 00000100:00100000:0.0:1788863555.566532:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454272 00000100:00100000:0.0:1788863555.569287:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454016 00000100:00100000:0.0:1788863555.569307:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454016 00000100:00100000:0.0:1788863555.569356:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863555.569369:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226454272:12345-0@lo:400: 00000100:00100000:0.0:1788863555.569500:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226454272:12345-0@lo:400: Request processed in 132us (4305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.569508:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863555.569529:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863555.569536:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226454016:12345-0@lo:400: 00000100:00100000:0.0:1788863555.569572:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226454016:12345-0@lo:400: Request processed in 37us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863555.569577:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788863555.569618:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863555.569625:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863555.569628:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863555.569677:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2f480 x1875759226453888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863555.569711:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226453888:0@lo:400: 00010000:00080000:0.0:1788863555.569726:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2c380 x1875759226454400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863555.569735:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226454400:0@lo:400: 00000100:00100000:0.0:1788863555.569761:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226454016:0@lo:400: 00010000:00080000:0.0:1788863555.569774:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e6712a9500 x1875759226454528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863555.569783:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226454528:0@lo:400: 00010000:00080000:1.0:1788863555.576153:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428ab480 x1875759226453760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863555.576207:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226453760:0@lo:13: 00000100:00100000:1.0:1788863555.576229:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226454272:0@lo:400: 00000100:00100000:1.0:1788863555.576243:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226453632:0@lo:400: 00010000:00080000:1.0:1788863555.576255:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681e2e680 x1875759226454144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863555.576264:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226454144:0@lo:400: 00010000:00080000:1.0:1788863555.576276:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681cabb80 x1875759226454656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863555.576284:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226454656:0@lo:400: 00010000:00010000:2.0:1788863555.756586:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863556.782112:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863557.101619:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863557.101657:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226454784:0@lo:41: 00000100:00100000:0.0:1788863557.101787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863557.101885:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454784 00000100:00100000:0.0:1788863557.101895:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454784 00000100:00100000:0.0:1788863557.101952:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863557.101962:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226454784:12345-0@lo:41: 00000004:00000024:0.0:1788863557.102004:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788863557.102055:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226454784:12345-0@lo:41: Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863557.102063:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863557.102145:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226454784:0@lo:41: 00000100:00100000:0.0:1788863557.110652:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226454912:0@lo:41: 00000100:00100000:0.0:1788863557.110748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863557.121559:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226454912 00000100:00100000:2.0:1788863557.121581:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226454912 00000100:00100000:2.0:1788863557.121661:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788863557.121673:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226454912:12345-0@lo:41: 00000004:00000024:2.0:1788863557.121728:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788863557.122482:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226454912:12345-0@lo:41: Request processed in 808us (11730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863557.122523:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788863557.123519:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226454912:0@lo:41: 00010000:00010000:2.0:1788863557.803556:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863558.828888:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863559.852508:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863560.685312:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226455040:0@lo:13: 00000100:00100000:3.0:1788863560.685417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863560.685616:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455040 00000100:00100000:1.0:1788863560.685626:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455040 00000100:00100000:1.0:1788863560.685692:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863560.685702:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226455040:12345-0@lo:13: 00002000:00000024:1.0:1788863560.685734:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863560.685789:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226455040:12345-0@lo:13: Request processed in 89us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863560.685795:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788863560.685842:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af54000 x1875759226455040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863560.685861:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226455040:0@lo:13: 00000100:00080000:3.0:1788863560.685986:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863560.686850:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226455552:0@lo:400: 00000100:00100000:1.0:1788863560.686904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863560.686928:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226456064:0@lo:400: 00000100:00100000:1.0:1788863560.686970:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863560.687004:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788863560.687010:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226455424:0@lo:400: 00000100:00100000:1.0:1788863560.687033:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863560.687051:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226455936:0@lo:400: 00000100:00100000:1.0:1788863560.687100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863560.687130:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456064 00000100:00100000:1.0:1788863560.687137:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456064 00000100:00100000:1.0:1788863560.687188:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863560.687196:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226456064:12345-0@lo:400: 00000100:00100000:1.0:1788863560.687242:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226456064:12345-0@lo:400: Request processed in 46us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863560.687248:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863560.687271:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455424 00000100:00100000:1.0:1788863560.687351:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455424 00000100:00100000:1.0:1788863560.687447:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788863560.687455:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226455424:12345-0@lo:400: 00000100:00100000:1.0:1788863560.687490:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226455424:12345-0@lo:400: Request processed in 37us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863560.687496:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788863560.687539:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226455424:0@lo:400: 00010000:00080000:1.0:1788863560.687552:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af54e00 x1875759226456064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863560.687562:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226456064:0@lo:400: 00000100:00100000:0.0:1788863560.687786:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226455168:0@lo:400: 00000100:00100000:0.0:1788863560.687824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863560.687864:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226455680:0@lo:400: 00000100:00100000:0.0:1788863560.687886:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863560.687905:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788863560.687918:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226455296:0@lo:400: 00000100:00100000:0.0:1788863560.687943:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863560.687959:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226455808:0@lo:400: 00000100:00100000:0.0:1788863560.687978:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863560.688003:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455552 00000100:00100000:0.0:1788863560.688007:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455552 00000100:00100000:0.0:1788863560.688032:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455936 00000100:00100000:0.0:1788863560.688034:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455936 00000100:00100000:0.0:1788863560.688048:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455296 00000100:00100000:0.0:1788863560.688050:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455296 00000100:00100000:0.0:1788863560.688059:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455808 00000100:00100000:0.0:1788863560.688062:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455808 00000100:00100000:0.0:1788863560.688100:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863560.688107:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226455552:12345-0@lo:400: 00000100:00100000:0.0:1788863560.688145:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226455552:12345-0@lo:400: Request processed in 39us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863560.688151:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863560.688165:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863560.688170:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226455936:12345-0@lo:400: 00000100:00100000:0.0:1788863560.688196:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226455936:12345-0@lo:400: Request processed in 26us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863560.688201:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863560.688210:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863560.688214:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226455296:12345-0@lo:400: 00000100:00100000:0.0:1788863560.688243:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226455296:12345-0@lo:400: Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863560.688248:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863560.688259:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863560.688284:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226455808:12345-0@lo:400: 00000100:00100000:0.0:1788863560.688314:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226455808:12345-0@lo:400: Request processed in 43us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863560.688319:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788863560.688352:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af55180 x1875759226455296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863560.688363:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226455296:0@lo:400: 00010000:00080000:0.0:1788863560.688372:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af54700 x1875759226455808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863560.688396:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226455808:0@lo:400: 00000100:00100000:0.0:1788863560.688417:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455680 00000100:00100000:0.0:1788863560.688420:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455680 00000100:00100000:0.0:1788863560.688442:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863560.688447:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226455680:12345-0@lo:400: 00000100:00100000:0.0:1788863560.688480:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226455680:12345-0@lo:400: Request processed in 33us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863560.688486:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863560.688507:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226455680:0@lo:400: 00010000:00080000:0.0:1788863560.688528:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af57b80 x1875759226455936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863560.688537:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226455936:0@lo:400: 00010000:00080000:0.0:1788863560.688548:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af57100 x1875759226455552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863560.688556:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226455552:0@lo:400: 00000100:00100000:1.0:1788863560.690289:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226455168 00000100:00100000:1.0:1788863560.690305:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226455168 00000100:00100000:1.0:1788863560.690365:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788863560.690374:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3640:x1875759226455168:12345-0@lo:400: 00000100:00100000:1.0:1788863560.690606:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3640:x1875759226455168:12345-0@lo:400: Request processed in 233us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863560.690614:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863560.690789:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226455168:0@lo:400: 00000100:00100000:3.0:1788863560.692691:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863560.692718:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226456192:0@lo:13: 00000100:00100000:3.0:1788863560.692786:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863560.692841:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456192 00000100:00100000:3.0:1788863560.692849:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456192 00000100:00100000:3.0:1788863560.692902:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863560.692911:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226456192:12345-0@lo:13: 00002000:00000024:3.0:1788863560.692937:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863560.692981:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226456192:12345-0@lo:13: Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863560.692988:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788863560.693030:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef5180 x1875759226456192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863560.693049:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226456192:0@lo:13: 00000100:00080000:3.0:1788863560.693071:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863560.693098:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863560.693101:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788863560.877647:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788863561.678142:0:9528:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788863561.678147:0:9528:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788863561.678149:0:9528:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788863561.678296:0:9528:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e67aeee000 00000020:01000004:2.0:1788863561.678315:0:9528:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788863561.678330:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788863561.678354:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89e5428eb380) 00000020:00000080:2.0:1788863561.678388:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788863561.756630:0:9528:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788863561.760677:0:9528:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788863561.807199:0:9528:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788863561.807584:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788863561.807604:0:9528:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788863561.807768:0:9528:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf569beb9d4b68bb0 00000020:01000004:1.0:1788863561.807779:0:9528:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788863561.807812:0:9528:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788863561.807816:0:9528:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788863561.807824:0:9528:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788863561.807865:0:9528:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788863561.807870:0:9528:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788863561.854808:0:9528:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788863561.854864:0:9528:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.135@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788863561.854869:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788863561.854871:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863561.854873:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863561.854874:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863561.854875:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863561.854876:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863561.854878:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863561.854880:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863561.854881:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863561.854883:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863561.854885:0:9528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863561.854890:0:9528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788863561.854892:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863561.854893:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863561.854894:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863561.854895:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863561.854896:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863561.854898:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863561.854899:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863561.854900:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863561.854900:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863561.854901:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863561.854902:0:9528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863561.854939:0:9528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788863561.854967:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226456320:0@lo:253: 00000100:00100000:0.0:1788863561.855067:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.855210:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863561.857655:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456320 00000100:00100000:2.0:1788863561.857685:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456320 00000100:00100000:2.0:1788863561.857769:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788863561.857781:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:9528:x1875759226456320:12345-0@lo:253: 20000000:01000000:2.0:1788863561.857819:0:6530:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788863561.857823:0:6530:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788863561.857828:0:6530:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788863561.857831:0:6530:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788863561.858192:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863561.858350:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788863561.858378:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788863561.858396:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788863561.858402:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788863561.858413:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788863561.858426:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788863561.858510:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788863561.858529:0:6530:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:2.0:1788863561.858536:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:2.0:1788863561.858559:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788863561.858566:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788863561.858580:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788863561.858585:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:2.0:1788863561.858596:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788863561.858602:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788863561.858613:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788863561.858628:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788863561.858697:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788863561.858709:0:6530:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:2.0:1788863561.858710:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:2.0:1788863561.858723:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788863561.858729:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788863561.858741:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788863561.858746:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:2.0:1788863561.858759:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788863561.858764:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788863561.858777:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788863561.858792:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788863561.859174:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788863561.859191:0:6530:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:2.0:1788863561.859193:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:2.0:1788863561.859210:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788863561.859224:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788863561.859238:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788863561.859245:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:2.0:1788863561.859258:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788863561.859263:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788863561.859273:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788863561.859300:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788863561.859314:0:6530:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788863561.859317:0:6530:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788863561.859321:0:6530:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788863561.859376:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788863561.859379:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788863561.859937:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788863561.859989:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788863561.860008:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788863561.870865:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788863561.870911:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788863561.870928:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788863561.870955:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788863561.870958:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788863561.871673:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788863561.871701:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788863561.871719:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788863561.871959:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788863561.871986:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788863561.872002:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788863561.872014:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788863561.872016:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788863561.873010:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788863561.873061:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788863561.873112:0:9536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788863561.873406:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788863561.873433:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788863561.873463:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788863561.873475:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788863561.873477:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788863561.873833:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788863561.873853:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788863561.873866:0:9537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788863561.874014:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788863561.874033:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788863561.874048:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788863561.874070:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788863561.874072:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788863561.874679:0:9538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788863561.874830:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788863561.874853:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788863561.874867:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1788863561.874886:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788863561.874915:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874939:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874947:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874954:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874961:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874968:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874974:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874981:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.874989:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.875040:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.875067:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 21 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863561.875168:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226456448:0@lo:104: 00000100:00100000:2.0:1788863561.875380:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863561.875456:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.875466:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 21 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.875475:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226456576:0@lo:104: 00000100:00100000:2.0:1788863561.875499:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863561.875533:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.875543:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 21 pid: 6532 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.875552:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226456704:0@lo:104: 00000100:00100000:2.0:1788863561.875574:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.875608:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456448 00000100:00100000:2.0:1788863561.875617:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456448 00000100:00100000:2.0:1788863561.875657:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456576 00000100:00100000:2.0:1788863561.875660:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456576 00000100:00100000:2.0:1788863561.875670:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456704 00000100:00100000:2.0:1788863561.875672:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456704 00000100:00100000:2.0:1788863561.875687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863561.875696:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:6530:x1875759226456448:12345-0@lo:104: 00010000:00010000:2.0:1788863561.875709:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.875765:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863561.875772:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:6530:x1875759226456448:12345-0@lo:104: Request processed in 77us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.875780:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863561.875798:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863561.875803:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6530:x1875759226456576:12345-0@lo:104: 00010000:00010000:2.0:1788863561.875811:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.875843:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788863561.875848:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6530:x1875759226456576:12345-0@lo:104: Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.875861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863561.875876:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863561.875882:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226456704:12345-0@lo:104: 00010000:00010000:2.0:1788863561.875889:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.875916:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788863561.875921:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226456704:12345-0@lo:104: Request processed in 41us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.875925:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788863561.875943:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788863561.875950:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.875957:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.875961:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.875972:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.875979:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.875985:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.876018:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876026:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.876052:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876060:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876105:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863561.876109:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876116:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.876119:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876126:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.876132:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.876138:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.876154:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876160:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.876177:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876183:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b68b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876192:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863561.876202:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876208:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167dc00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.876211:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876219:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.876226:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.876232:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.876246:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876252:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.876258:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876265:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68b55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b5c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876275:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.876276:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.876278:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.876285:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863561.876303:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863561.876318:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226456832:0@lo:103: 00000100:00100000:2.0:1788863561.876352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.876419:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226456960:0@lo:103: 00000100:00100000:2.0:1788863561.876466:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.876488:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863561.876494:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226457088:0@lo:103: 00000100:00100000:2.0:1788863561.876518:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.876554:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456832 00000100:00100000:2.0:1788863561.876559:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456832 00010000:00010000:2.0:1788863561.876582:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 22 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.876600:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226456960 00000100:00100000:2.0:1788863561.876603:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226456960 00010000:00010000:2.0:1788863561.876616:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 23 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.876626:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457088 00000100:00100000:2.0:1788863561.876629:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457088 00010000:00010000:2.0:1788863561.876639:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 24 pid: 6532 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.876652:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863561.876659:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226456832:12345-0@lo:103: 00010000:00010000:2.0:1788863561.876671:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863561.876677:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 24 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876689:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 24 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876708:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863561.876745:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226456832:12345-0@lo:103: Request processed in 87us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.876752:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863561.876770:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863561.876777:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:3642:x1875759226456960:12345-0@lo:103: 00010000:00010000:2.0:1788863561.876785:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863561.876789:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 23 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876798:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 23 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876808:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863561.876834:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:3642:x1875759226456960:12345-0@lo:103: Request processed in 58us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.876840:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863561.876853:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863561.876859:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3642:x1875759226457088:12345-0@lo:103: 00010000:00010000:2.0:1788863561.876867:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863561.876871:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 22 pid: 6532 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876880:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 22 pid: 6532 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.876891:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863561.876912:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3642:x1875759226457088:12345-0@lo:103: Request processed in 53us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.876918:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863561.876973:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226456832:0@lo:103: 00000100:00100000:2.0:1788863561.877002:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226457088:0@lo:103: 00000100:00100000:2.0:1788863561.877011:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226456960:0@lo:103: 00010000:00010000:2.0:1788863561.877043:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877055:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 21 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.877066:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457216:0@lo:104: 00000100:00100000:2.0:1788863561.877125:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.877150:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457216 00000100:00100000:2.0:1788863561.877153:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457216 00000100:00100000:2.0:1788863561.877170:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863561.877176:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226457216:12345-0@lo:104: 00010000:00010000:2.0:1788863561.877184:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877218:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863561.877223:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226457216:12345-0@lo:104: Request processed in 48us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.877229:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788863561.877245:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863561.877249:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877257:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.877267:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877274:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.877281:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.877287:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.877304:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877310:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.877318:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877324:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b68b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b32 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877335:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.877337:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.877339:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863561.877351:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226457344:0@lo:103: 00000100:00100000:2.0:1788863561.877392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.877425:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457344 00000100:00100000:2.0:1788863561.877429:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457344 00010000:00010000:2.0:1788863561.877442:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 22 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.877460:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863561.877471:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3640:x1875759226457344:12345-0@lo:103: 00010000:00010000:2.0:1788863561.877479:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863561.877484:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 22 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877493:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 22 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877503:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863561.877527:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3640:x1875759226457344:12345-0@lo:103: Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.877533:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863561.877585:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226457344:0@lo:103: 00010000:00010000:2.0:1788863561.877609:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877620:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 21 pid: 6532 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.877636:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457472:0@lo:104: 00000100:00100000:2.0:1788863561.877659:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.877676:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457472 00000100:00100000:2.0:1788863561.877680:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457472 00000100:00100000:2.0:1788863561.877695:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863561.877701:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226457472:12345-0@lo:104: 00010000:00010000:2.0:1788863561.877709:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877738:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863561.877750:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226457472:12345-0@lo:104: Request processed in 50us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.877757:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788863561.877772:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863561.877777:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877784:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.877788:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877796:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.877803:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.877809:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.877829:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877835:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.877844:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877850:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b16 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.877861:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.877864:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.877865:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863561.877881:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863561.877890:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226457600:0@lo:103: 00000100:00100000:2.0:1788863561.877933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.877955:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457600 00000100:00100000:2.0:1788863561.877959:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457600 00010000:00010000:2.0:1788863561.877973:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 22 pid: 6532 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.877991:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863561.877998:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3640:x1875759226457600:12345-0@lo:103: 00010000:00010000:2.0:1788863561.878005:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863561.878009:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 22 pid: 6532 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.878019:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 22 pid: 6532 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.878029:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863561.878054:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3640:x1875759226457600:12345-0@lo:103: Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.878060:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863561.878732:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226457600:0@lo:103: 00010000:00010000:2.0:1788863561.878782:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.878794:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 21 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.878805:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457728:0@lo:104: 00000100:00100000:2.0:1788863561.878852:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863561.878925:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.878933:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 21 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.878942:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457856:0@lo:104: 00000100:00100000:2.0:1788863561.878962:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788863561.878977:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68ba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68b9b expref: 21 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.878988:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226456448:0@lo:104: 00010000:00010000:2.0:1788863561.878997:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641537000/0xf569beb9d4b68b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68b71 expref: 20 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.879006:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226456576:0@lo:104: 00010000:00010000:2.0:1788863561.879015:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167c200/0xf569beb9d4b68b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68b55 expref: 19 pid: 6532 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.879024:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226456704:0@lo:104: 00010000:00010000:2.0:1788863561.879035:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68b2b expref: 18 pid: 6530 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.879044:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457216:0@lo:104: 00010000:00010000:2.0:1788863561.879052:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68b0f expref: 17 pid: 6532 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.879061:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457472:0@lo:104: 00000100:00100000:3.0:1788863561.879531:0:6521:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788863561.879553:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863561.879608:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457728 00000100:00100000:3.0:1788863561.879615:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457728 00000100:00100000:2.0:1788863561.879689:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457856 00000100:00100000:2.0:1788863561.879693:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457856 00000100:00100000:2.0:1788863561.879729:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788863561.879739:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542762850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6530:x1875759226457728:12345-0@lo:104: 00010000:00010000:2.0:1788863561.879753:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863561.879866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788863561.879876:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6530:x1875759226457856:12345-0@lo:104: 00010000:00010000:0.0:1788863561.879884:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.879962:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863561.879968:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542762850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6530:x1875759226457728:12345-0@lo:104: Request processed in 231us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.879976:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788863561.880035:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863561.880041:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880049:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.880053:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880063:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.880070:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.880118:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.880171:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880179:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.880204:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880212:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640031800/0xf569beb9d4b68ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ad7 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880225:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.880227:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.880229:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863561.880246:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863561.880262:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226457984:0@lo:103: 00000100:00100000:2.0:1788863561.880314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.880382:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226457984 00000100:00100000:2.0:1788863561.880387:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226457984 00010000:00010000:2.0:1788863561.880408:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 17 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.880430:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788863561.880436:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3643:x1875759226457984:12345-0@lo:103: 00010000:00010000:2.0:1788863561.880445:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863561.880450:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 17 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880462:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 17 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880483:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863561.880509:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3643:x1875759226457984:12345-0@lo:103: Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.880517:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788863561.880562:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226457984:0@lo:103: 00010000:00010000:0.0:1788863561.880866:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863561.880872:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6530:x1875759226457856:12345-0@lo:104: Request processed in 1000us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863561.880880:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788863561.880985:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863561.880992:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.880999:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.881003:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.881010:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.881016:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.881021:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.881053:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.881060:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.881157:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.881165:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68aad expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.881179:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.881181:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.881183:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863561.881318:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226458112:0@lo:103: 00000100:00100000:0.0:1788863561.881357:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863561.881457:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226458112 00000100:00100000:3.0:1788863561.881463:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226458112 00010000:00010000:3.0:1788863561.881483:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 17 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863561.881525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788863561.881532:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3643:x1875759226458112:12345-0@lo:103: 00010000:00010000:3.0:1788863561.881545:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863561.881550:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 17 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881561:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 17 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881577:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881588:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881605:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881613:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881622:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881630:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881635:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650115800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863561.881640:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881654:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881664:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.881674:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863561.881710:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3643:x1875759226458112:12345-0@lo:103: Request processed in 178us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863561.881717:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788863561.881747:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226458112:0@lo:103: 00010000:00010000:1.0:1788863561.884766:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114e00/0xf569beb9d4b68ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68ad0 expref: 16 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863561.884795:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457728:0@lo:104: 00010000:00010000:1.0:1788863561.884823:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641536600/0xf569beb9d4b68aad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68aa6 expref: 15 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863561.884835:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6530:1875759226457856:0@lo:104: 00010000:00010000:1.0:1788863561.884890:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.884902:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.884909:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.884916:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788863561.884934:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788863561.893506:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:9528:x1875759226456320:12345-0@lo:253: Request processed in 35709us (38420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863561.893527:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788863561.893695:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226456320:0@lo:253: 10000000:01000000:0.0:1788863561.893716:0:9528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788863561.893721:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788863561.893723:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863561.893725:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863561.893726:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788863561.893727:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863561.893729:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863561.893731:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863561.893733:0:9528:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788863561.893734:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863561.893736:0:9528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788863561.893764:0:9528:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e67aeee000 from lustre-OST0001 10000000:01000000:0.0:1788863561.893805:0:9528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788863561.893810:0:9528:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788863561.893821:0:9528:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e671354d40 local copy 10000000:01000000:0.0:1788863561.893826:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788863561.893878:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.893892:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.893903:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863561.893930:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458240:0@lo:101: 00000100:00100000:0.0:1788863561.893973:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.894023:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81180 going to sleep for 11 seconds 00000100:00100000:2.0:1788863561.894113:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226458240 00000100:00100000:2.0:1788863561.894122:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226458240 00000100:00100000:2.0:1788863561.894176:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788863561.894185:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+14:9528:x1875759226458240:12345-0@lo:101: 00010000:00010000:2.0:1788863561.894200:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863561.894215:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68bbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.894241:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68bbe expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.894253:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68bbe expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.894264:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98000, rc 0) 00000100:00100000:2.0:1788863561.894312:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:9528:x1875759226458240:12345-0@lo:101: Request processed in 128us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.894319:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788863561.894447:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458240:0@lo:101: 00010000:00010000:0.0:1788863561.894459:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.894469:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863561.894574:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458368:0@lo:501: 00000100:00100000:0.0:1788863561.894599:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.894627:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81180 going to sleep for 11 seconds 00000100:00100000:2.0:1788863561.894680:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226458368 00000100:00100000:2.0:1788863561.894684:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226458368 00000100:00100000:2.0:1788863561.894715:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788863561.894722:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:9528:x1875759226458368:12345-0@lo:501: 00000100:00100000:2.0:1788863561.894784:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:9528:x1875759226458368:12345-0@lo:501: Request processed in 62us (184us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863561.894791:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788863561.894861:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458368:0@lo:501: 10000000:01000000:0.0:1788863561.894873:0:9528:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788863561.894891:0:9528:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788863561.894897:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.894905:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.894912:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.894936:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788863561.894973:0:9528:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e67aeee000 10000000:01000000:0.0:1788863561.894978:0:9528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788863561.894983:0:9528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788863561.894986:0:9528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863561.894991:0:9528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788863561.894994:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788863561.895009:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.895017:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.895026:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863561.895037:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458496:0@lo:101: 00000100:00100000:0.0:1788863561.895063:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.895107:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863561.895199:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226458496 00000100:00100000:1.0:1788863561.895204:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226458496 00000100:00100000:1.0:1788863561.895241:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788863561.895249:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:9528:x1875759226458496:12345-0@lo:101: 00010000:00010000:1.0:1788863561.895258:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863561.895269:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68bcc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.895298:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.895308:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.895316:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650115800, rc 0) 00000100:00100000:1.0:1788863561.895349:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226458496:12345-0@lo:101: Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863561.895357:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:2.0:1788863561.895506:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863561.895513:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.895520:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031c00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863561.895525:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.895543:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863561.895550:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.895557:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863561.895581:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.895588:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863561.895620:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.895628:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf569beb9d4b68bc5 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.895641:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.895643:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863561.895644:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863561.895654:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863561.895667:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226458624:0@lo:103: 00000100:00100000:2.0:1788863561.895703:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.895825:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458496:0@lo:101: 00010000:00010000:0.0:1788863561.895839:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.895848:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863561.895923:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458752:0@lo:501: 00000100:00100000:0.0:1788863561.895950:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.895972:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863561.896023:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226458752 00000100:00100000:2.0:1788863561.896028:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226458752 00000100:00100000:2.0:1788863561.896061:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788863561.896069:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226458752:12345-0@lo:501: 00000100:00100000:2.0:1788863561.896213:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226458752:12345-0@lo:501: Request processed in 145us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.896231:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788863561.896309:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458752:0@lo:501: 00000100:00100000:0.0:1788863561.896343:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458880:0@lo:503: 00000100:00100000:0.0:1788863561.896399:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.896428:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863561.896446:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226458880 00000100:00100000:0.0:1788863561.896451:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226458880 00000100:00100000:0.0:1788863561.896473:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788863561.896480:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226458880:12345-0@lo:503: 00000100:00100000:0.0:1788863561.896579:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226458880:12345-0@lo:503: Request processed in 99us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863561.896587:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788863561.896632:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226458880:0@lo:503: 00000040:00080000:0.0:1788863561.896977:0:9528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863561.897067:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459008:0@lo:502: 00000100:00100000:0.0:1788863561.897145:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.897162:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863561.897180:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459008 00000100:00100000:0.0:1788863561.897185:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459008 00000100:00100000:0.0:1788863561.897205:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788863561.897212:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459008:12345-0@lo:502: 00000100:00100000:0.0:1788863561.897301:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459008:12345-0@lo:502: Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863561.897309:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788863561.897353:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459008:0@lo:502: 00000040:00080000:0.0:1788863561.897576:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788863561.897604:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788863561.897616:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788863561.897637:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788863561.897650:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788863561.897663:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788863561.897686:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459136:0@lo:502: 00000100:00100000:0.0:1788863561.897723:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863561.897738:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863561.897754:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459136 00000100:00100000:0.0:1788863561.897758:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459136 00000100:00100000:0.0:1788863561.897776:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788863561.897782:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459136:12345-0@lo:502: 00000100:00100000:0.0:1788863561.897852:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459136:12345-0@lo:502: Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863561.897859:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788863561.897898:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459136:0@lo:502: 00000040:00080000:0.0:1788863561.897933:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788863561.897941:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:3.0:1788863561.898640:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226458624 00000100:00100000:3.0:1788863561.898649:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226458624 00000100:00100000:3.0:1788863561.898700:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863561.898710:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:3641:x1875759226458624:12345-0@lo:103: 00010000:00010000:3.0:1788863561.898728:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863561.898754:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98000/0xf569beb9d4b68bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68bbe expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863561.898774:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863561.898826:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3641:x1875759226458624:12345-0@lo:103: Request processed in 119us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863561.898833:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863561.898874:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226458624:0@lo:103: 00010000:00010000:2.0:1788863561.900311:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788863561.900895:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788863561.900907:0:9539:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788863561.900916:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863561.900919:0:9539:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788863561.900928:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863561.900951:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89e5428e8000) 00000020:00000080:2.0:1788863561.900984:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788863561.900991:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788863561.906933:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67aeee000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788863561.906959:0:9539:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788863561.906977:0:9539:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf569beb9d4b68be1 00010000:00010000:3.0:1788863561.917690:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788863561.918717:0:9539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788863561.923721:0:9539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788863561.924260:0:9539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788863561.942421:0:9539:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788863561.944201:0:9539:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788863561.960470:0:9539:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788863561.962745:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788863561.962763:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863561.962772:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863561.962775:0:9539:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788863561.962779:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863561.962783:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863561.962785:0:9539:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788863561.962788:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863561.962790:0:9539:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788863561.962836:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863561.962840:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863561.962842:0:9539:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788863561.962853:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788863561.963003:0:9528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788863561.963053:0:9528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788863561.963131:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.963149:0:9528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863561.963158:0:9528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67aeee000 from 1 10000000:01000000:2.0:1788863561.963161:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863561.963207:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.963215:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.963227:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.963283:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459264:0@lo:101: 00000100:00100000:2.0:1788863561.963371:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.963426:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863561.965817:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459264 00000100:00100000:0.0:1788863561.965884:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459264 00000100:00100000:0.0:1788863561.965969:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788863561.965981:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:9528:x1875759226459264:12345-0@lo:101: 00010000:00010000:0.0:1788863561.966004:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863561.966028:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68be8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.966065:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.966111:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863561.966124:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031400, rc 0) 00000100:00100000:0.0:1788863561.966227:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459264:12345-0@lo:101: Request processed in 248us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863561.966234:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788863561.966396:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459264:0@lo:101: 00010000:00010000:2.0:1788863561.966434:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863561.966449:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863561.966589:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459392:0@lo:501: 00000100:00100000:2.0:1788863561.966644:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.966763:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863561.966785:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459392 00000100:00100000:0.0:1788863561.966795:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459392 00000100:00100000:2.0:1788863561.967794:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788863561.967817:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459392:12345-0@lo:501: 00000100:00100000:2.0:1788863561.967993:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459392:12345-0@lo:501: Request processed in 187us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.968002:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788863561.970433:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459392:0@lo:501: 00000100:00100000:1.0:1788863561.970916:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459520:0@lo:503: 00000100:00100000:1.0:1788863561.971012:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863561.971156:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863561.973678:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459520 00000100:00100000:0.0:1788863561.973699:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459520 00000100:00100000:0.0:1788863561.973791:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788863561.973804:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459520:12345-0@lo:503: 00000100:00100000:0.0:1788863561.974282:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459520:12345-0@lo:503: Request processed in 478us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863561.974304:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788863561.974608:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459520:0@lo:503: 00000040:00080000:1.0:1788863561.982796:0:9528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863561.982986:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459648:0@lo:502: 00000100:00100000:1.0:1788863561.984225:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863561.984927:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459648 00000100:00100000:2.0:1788863561.984943:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459648 00000100:00100000:2.0:1788863561.985031:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788863561.985043:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459648:12345-0@lo:502: 00000100:00100000:1.0:1788863561.985783:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863561.986432:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459648:12345-0@lo:502: Request processed in 1387us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863561.986442:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788863561.987400:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459648:0@lo:502: 00000040:00080000:1.0:1788863561.989255:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788863561.989333:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788863561.989407:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459776:0@lo:502: 00000100:00100000:1.0:1788863561.989515:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863561.989580:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863561.990305:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459776 00000100:00100000:0.0:1788863561.990331:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459776 00000100:00100000:0.0:1788863561.990403:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788863561.990413:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459776:12345-0@lo:502: 00000100:00100000:0.0:1788863561.990585:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459776:12345-0@lo:502: Request processed in 172us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863561.990594:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788863561.991410:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459776:0@lo:502: 00000040:00080000:1.0:1788863561.991527:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788863561.991544:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788863561.998262:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863561.998282:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863561.998284:0:9543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788863561.998296:0:9543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e67aeee000 00000020:00000080:0.0:1788863561.998299:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788863561.998313:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863561.998315:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863561.998317:0:9543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788863561.998320:0:9543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788863561.998883:0:9528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788863561.998929:0:9528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788863561.998961:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.998977:0:9528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863561.999061:0:9528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788863561.999065:0:9528:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e67aeee000 10000000:01000000:1.0:1788863561.999069:0:9528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e67aeee000 10000000:01000000:1.0:1788863561.999104:0:9528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863561.999113:0:9528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e67aeee000 from 1 10000000:01000000:1.0:1788863561.999116:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863561.999168:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.999178:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863561.999213:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863561.999246:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459904:0@lo:101: 00000100:00100000:1.0:1788863561.999335:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863561.999413:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863562.000170:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226459904 00000100:00100000:0.0:1788863562.000182:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226459904 00000100:00100000:0.0:1788863562.000242:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788863562.000252:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226459904:12345-0@lo:101: 00010000:00010000:0.0:1788863562.000271:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863562.000289:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68bf6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.000321:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.000334:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.000344:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031000, rc 0) 00000100:00100000:0.0:1788863562.000444:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226459904:12345-0@lo:101: Request processed in 193us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.000453:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788863562.000650:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226459904:0@lo:101: 00010000:00010000:3.0:1788863562.000679:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863562.000689:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863562.000849:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460032:0@lo:501: 00000100:00100000:3.0:1788863562.000889:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863562.000933:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863562.001725:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460032 00000100:00100000:0.0:1788863562.001736:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460032 00000100:00100000:0.0:1788863562.001792:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788863562.001801:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460032:12345-0@lo:501: 00000100:00100000:0.0:1788863562.001969:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460032:12345-0@lo:501: Request processed in 168us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.001977:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788863562.002273:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460032:0@lo:501: 00000100:00100000:2.0:1788863562.002349:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460160:0@lo:503: 00000100:00100000:2.0:1788863562.002428:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.002474:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647ff5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863562.002942:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460160 00000100:00100000:3.0:1788863562.002950:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460160 00000100:00100000:3.0:1788863562.002985:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788863562.002995:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460160:12345-0@lo:503: 00000100:00100000:3.0:1788863562.003159:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460160:12345-0@lo:503: Request processed in 165us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863562.003167:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788863562.003400:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460160:0@lo:503: 00000040:00080000:2.0:1788863562.003796:0:9528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863562.003887:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460288:0@lo:502: 00000100:00100000:2.0:1788863562.005919:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.005993:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863562.006155:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460288 00000100:00100000:0.0:1788863562.006169:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460288 00000100:00100000:0.0:1788863562.006234:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788863562.006245:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460288:12345-0@lo:502: 00000100:00100000:0.0:1788863562.006448:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460288:12345-0@lo:502: Request processed in 204us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.006457:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788863562.006972:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460288:0@lo:502: 00000040:00080000:2.0:1788863562.007526:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788863562.007569:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788863562.007585:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788863562.007599:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788863562.007610:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788863562.008792:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788863562.008837:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788863562.008854:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788863562.008868:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788863562.008880:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788863562.008893:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788863562.008906:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788863562.008921:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788863562.008934:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788863562.008946:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788863562.008958:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788863562.008970:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788863562.008984:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788863562.008996:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788863562.009024:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788863562.009037:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788863562.009065:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788863562.009453:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788863562.009474:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788863562.009488:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788863562.009502:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788863562.009516:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788863562.009529:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788863562.009543:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788863562.009556:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788863562.009569:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788863562.009582:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788863562.009595:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788863562.009607:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788863562.009638:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788863562.009655:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788863562.009668:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788863562.009680:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788863562.009710:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788863562.009725:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788863562.009737:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788863562.009750:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788863562.009764:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788863562.009777:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788863562.009790:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788863562.009802:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788863562.009869:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460416:0@lo:502: 00000100:00100000:2.0:1788863562.009982:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.010065:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863562.010240:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460416 00000100:00100000:0.0:1788863562.010251:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460416 00000100:00100000:0.0:1788863562.010315:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788863562.010325:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460416:12345-0@lo:502: 00000100:00100000:0.0:1788863562.011942:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226460416:12345-0@lo:502: Request processed in 1608us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.011958:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788863562.012877:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226460416:0@lo:502: 00000040:00080000:2.0:1788863562.013028:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788863562.013063:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788863562.014757:0:9544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788863562.014781:0:9544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89e5428e99c0) 00000020:00000080:2.0:1788863562.014818:0:9544:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788863562.014939:0:9544:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67aeee000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788863562.014944:0:9544:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67aeee000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788863562.014947:0:9544:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67aeee000 3 00010000:00080000:2.0:1788863562.014992:0:9544:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e543427800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863562.018039:0:9544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788863562.018688:0:9544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788863562.018748:0:9544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863562.018767:0:9544:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf569beb9d4b68c0b 00000100:00080000:2.0:1788863562.018782:0:9544:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863562.018798:0:9544:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e543427800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863562.018937:0:9544:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543440a80 x1875759226460544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863562.018975:0:9544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788863562.019198:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226460544:0@lo:38: 00000100:00100000:1.0:1788863562.019295:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863562.019486:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460544 00000100:00100000:3.0:1788863562.019497:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460544 00000100:00100000:3.0:1788863562.019549:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863562.019559:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226460544:12345-0@lo:38: 00010000:00080000:3.0:1788863562.019590:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1788863562.019672:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf569beb9d4b68c12 00000004:00100000:3.0:1788863562.019694:0:6537:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788863562.019737:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e541e71000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863562.019810:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875759226460544:12345-0@lo:38: Request processed in 250us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863562.019819:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788863562.019888:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543440a80 x1875759226460544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863562.019898:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863562.019909:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788863562.019918:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788863562.019922:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788863562.019925:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788863562.019931:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226460544:0@lo:38: 00000020:01000004:1.0:1788863562.020686:0:9544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788863562.020709:0:9544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff89e6763c0000) 00000020:00000080:1.0:1788863562.020735:0:9544:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788863562.020845:0:9544:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67aeee000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788863562.020851:0:9544:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67aeee000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788863562.020854:0:9544:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67aeee000 3 00010000:00080000:1.0:1788863562.020911:0:9544:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e54343e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.135@tcp at head 00000100:00100000:3.0:1788863562.022345:0:9545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9545:1875759226460800:0@lo:901: 00000100:00100000:3.0:1788863562.022447:0:9545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863562.022501:0:9545:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863562.023267:0:6548:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460800 00000100:00100000:0.0:1788863562.023283:0:6548:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460800 00000100:00100000:0.0:1788863562.023395:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863562.023408:0:6548:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9545:x1875759226460800:12345-0@lo:901: 00000100:00100000:0.0:1788863562.023575:0:6548:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9545:x1875759226460800:12345-0@lo:901: Request processed in 170us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.023584:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863562.027555:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226461184:0@lo:400: 00000100:00100000:2.0:1788863562.027662:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.027707:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226461696:0@lo:400: 00000100:00100000:2.0:1788863562.027730:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.027759:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788863562.027766:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226460672:0@lo:400: 00000100:00100000:2.0:1788863562.027791:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.027808:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226461312:0@lo:400: 00000100:00100000:2.0:1788863562.028003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.028153:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226460928:0@lo:400: 00000100:00100000:2.0:1788863562.028183:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.028203:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226461440:0@lo:400: 00000100:00100000:2.0:1788863562.028222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.028410:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788863562.028418:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226461056:0@lo:400: 00000100:00100000:2.0:1788863562.028443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.028454:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226461568:0@lo:400: 00000100:00100000:2.0:1788863562.028476:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863562.028523:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461184 00000100:00100000:2.0:1788863562.028536:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461184 00000100:00100000:2.0:1788863562.028587:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460928 00000100:00100000:2.0:1788863562.028589:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460928 00000100:00100000:2.0:1788863562.028606:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788863562.028616:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226461184:12345-0@lo:400: 00000100:00100000:2.0:1788863562.028692:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226461184:12345-0@lo:400: Request processed in 76us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.028700:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788863562.028720:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788863562.028726:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226460928:12345-0@lo:400: 00000100:00100000:2.0:1788863562.028756:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226460928:12345-0@lo:400: Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.028762:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788863562.028783:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461696 00000100:00100000:2.0:1788863562.028787:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461696 00000100:00100000:2.0:1788863562.028820:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461568 00000100:00100000:2.0:1788863562.029020:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461568 00000100:00100000:2.0:1788863562.029065:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863562.029099:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226461696:12345-0@lo:400: 00000100:00100000:2.0:1788863562.029137:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226461696:12345-0@lo:400: Request processed in 41us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.029143:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863562.029156:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863562.029162:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226461568:12345-0@lo:400: 00000100:00100000:2.0:1788863562.029188:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226461568:12345-0@lo:400: Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.029193:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863562.029215:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226460672 00000100:00100000:2.0:1788863562.029219:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226460672 00000100:00100000:2.0:1788863562.029251:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461312 00000100:00100000:2.0:1788863562.029255:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461312 00000100:00100000:2.0:1788863562.029268:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461440 00000100:00100000:2.0:1788863562.029271:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461440 00000100:00100000:2.0:1788863562.029281:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461056 00000100:00100000:2.0:1788863562.029284:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461056 00010000:00010000:1.0:1788863562.029451:0:9544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1788863562.029491:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863562.029497:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226460672:12345-0@lo:400: 00000100:00100000:2.0:1788863562.029531:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226460672:12345-0@lo:400: Request processed in 34us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.029538:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863562.029549:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788863562.029554:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226461312:12345-0@lo:400: 00000100:00100000:2.0:1788863562.029578:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226461312:12345-0@lo:400: Request processed in 24us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.029583:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788863562.029593:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863562.029604:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226461440:12345-0@lo:400: 00000100:00100000:2.0:1788863562.029633:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226461440:12345-0@lo:400: Request processed in 30us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.029639:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863562.029649:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863562.029655:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226461056:12345-0@lo:400: 00000100:00100000:2.0:1788863562.029681:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226461056:12345-0@lo:400: Request processed in 27us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863562.029686:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788863562.029775:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788863562.029784:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543440380 x1875759226460672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788863562.029787:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863562.029790:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863562.029803:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226460672:0@lo:400: 00010000:00080000:2.0:1788863562.029815:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543440000 x1875759226461312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788863562.029836:0:9545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e541ef4380 x1875759226460800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788863578 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863562.029837:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226461312:0@lo:400: 00000100:00100000:3.0:1788863562.029847:0:9545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9545:1875759226460800:0@lo:901: 00000100:00100000:2.0:1788863562.029851:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226461184:0@lo:400: 00010000:00080000:2.0:1788863562.029862:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543440a80 x1875759226461696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863562.029869:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226461696:0@lo:400: 00010000:00080000:2.0:1788863562.029909:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543443480 x1875759226461056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863562.029917:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226461056:0@lo:400: 00010000:00080000:2.0:1788863562.029928:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543441500 x1875759226461568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863562.029942:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226461568:0@lo:400: 00000100:00100000:2.0:1788863562.029956:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226460928:0@lo:400: 00010000:00080000:2.0:1788863562.029966:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543441180 x1875759226461440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863562.029973:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226461440:0@lo:400: 00000020:00000080:1.0:1788863562.030309:0:9544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788863562.034182:0:9544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788863562.034213:0:9544:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf569beb9d4b68c20 00000100:00080000:1.0:1788863562.034230:0:9544:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863562.034246:0:9544:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89e54343e800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863562.034313:0:9544:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af57800 x1875759226461824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863562.034345:0:9544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788863562.034881:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226461824:0@lo:38: 00000100:00100000:3.0:1788863562.034985:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788863562.035262:0:9544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788863562.035477:0:9528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788863562.035519:0:9528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788863562.035539:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863562.035553:0:9528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788863562.035699:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788863562.035702:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788863562.035703:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863562.035705:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863562.035706:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863562.035708:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863562.035709:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788863562.035711:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788863562.035712:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788863562.035714:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863562.035715:0:9528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788863562.035720:0:9528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788863562.035723:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788863562.035724:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788863562.035725:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863562.035727:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863562.035728:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863562.035729:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863562.035730:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788863562.035732:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788863562.035733:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788863562.035734:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863562.035735:0:9528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788863562.035764:0:9528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788863562.035782:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226461952:0@lo:253: 00000100:00100000:3.0:1788863562.035843:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863562.035863:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863562.036154:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461824 00000100:00100000:2.0:1788863562.036165:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461824 00000100:00100000:2.0:1788863562.036216:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863562.036237:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226461824:12345-0@lo:38: 00010000:00080000:2.0:1788863562.036272:0:6538:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1788863562.036323:0:6538:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf569beb9d4b68c27 00000004:00100000:2.0:1788863562.036343:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788863562.036378:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226461952 00000100:00100000:1.0:1788863562.036384:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226461952 00000100:00080000:2.0:1788863562.036397:0:6538:0:(import.c:65:import_set_state_nolock()) ffff89e543427000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863562.036427:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788863562.036444:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9528:x1875759226461952:12345-0@lo:253: 00000100:00100000:2.0:1788863562.036467:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875759226461824:12345-0@lo:38: Request processed in 242us (1483us total) trans 0 rc 0/0 20000000:01000000:1.0:1788863562.036468:0:6532:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788863562.036474:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:1.0:1788863562.036487:0:6532:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788863562.037476:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af57800 x1875759226461824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863562.037493:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863562.037505:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788863562.037517:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788863562.037523:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788863562.037533:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e54343e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788863562.037543:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226461824:0@lo:38: 20000000:01000000:3.0:1788863562.055992:0:6532:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788863562.056020:0:6532:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788863562.057226:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788863562.057238:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788863562.057274:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.057308:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.057318:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.057326:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.057399:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.057421:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 17 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863562.057441:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226462080:0@lo:104: 00000100:00100000:0.0:1788863562.057535:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863562.059757:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.059783:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 17 pid: 6530 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863562.059823:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226462208:0@lo:104: 00000100:00100000:0.0:1788863562.059934:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863562.060012:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863562.060280:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462080 00000100:00100000:0.0:1788863562.060293:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462080 00000100:00100000:0.0:1788863562.060354:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462208 00000100:00100000:0.0:1788863562.060369:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462208 00000100:00100000:0.0:1788863562.060388:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863562.060398:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6552:x1875759226462080:12345-0@lo:104: 00010000:00010000:0.0:1788863562.060417:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.060487:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863562.060493:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:6552:x1875759226462080:12345-0@lo:104: Request processed in 97us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.060501:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863562.060521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863562.060527:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226462208:12345-0@lo:104: 00010000:00010000:0.0:1788863562.060535:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.060570:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788863562.060576:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:6552:x1875759226462208:12345-0@lo:104: Request processed in 49us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.060582:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788863562.061229:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863562.066417:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.066467:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537c00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863562.066473:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.066485:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863562.066492:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863562.066498:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863562.066646:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788863562.066835:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226462080:0@lo:104: 00000100:00100000:1.0:1788863562.066850:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875759226462208:0@lo:104: 00010000:00010000:1.0:1788863562.066885:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.073001:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.073023:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863562.073096:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.073106:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537c00/0xf569beb9d4b68b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b6a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.073136:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863562.073139:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863562.073142:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863562.074433:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226462336:0@lo:103: 00000100:00100000:3.0:1788863562.074536:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863562.074662:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462336 00000100:00100000:3.0:1788863562.074673:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462336 00010000:00010000:3.0:1788863562.074716:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 18 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863562.074754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863562.074764:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:3641:x1875759226462336:12345-0@lo:103: 00010000:00010000:3.0:1788863562.074781:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863562.074787:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 18 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863562.074802:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 18 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863562.074819:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68b63 expref: 18 pid: 6529 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863562.074836:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863562.074879:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3641:x1875759226462336:12345-0@lo:103: Request processed in 117us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863562.074887:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863562.074940:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226462336:0@lo:103: 00000100:00100000:3.0:1788863562.075319:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9528:x1875759226461952:12345-0@lo:253: Request processed in 38875us (39474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863562.075349:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788863562.075464:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9528:1875759226461952:0@lo:253: 10000000:01000000:1.0:1788863562.075480:0:9528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788863562.075485:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863562.075487:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788863562.075489:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863562.075490:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863562.075491:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863562.075492:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863562.075494:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863562.075496:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863562.075497:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863562.075499:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863562.075500:0:9528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788863562.075516:0:9528:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788863562.076864:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863562.076883:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.076898:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863562.076917:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.076929:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863562.076936:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863562.076942:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863562.078175:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863562.078184:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788863562.082696:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:0.0:1788863562.084205:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084225:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863562.084261:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084270:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537a00/0xf569beb9d4b68b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68b24 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084297:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863562.084300:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863562.084303:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863562.084337:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226462464:0@lo:103: 00000100:00100000:0.0:1788863562.084440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863562.084537:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462464 00000100:00100000:0.0:1788863562.084547:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462464 00010000:00010000:0.0:1788863562.084588:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 16 pid: 6530 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863562.084806:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863562.084840:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:3642:x1875759226462464:12345-0@lo:103: 00010000:00010000:0.0:1788863562.084858:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863562.084866:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 16 pid: 6530 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084879:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 16 pid: 6530 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084895:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68b24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68b1d expref: 16 pid: 6530 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084912:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084922:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788863562.084940:0:6523:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.027704637s 00010000:00010000:0.0:1788863562.084946:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084953:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084960:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084968:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084976:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863562.084988:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.084998:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788863562.085282:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:3.0:1788863562.085698:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863562.085712:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788863562.085728:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00010000:00010000:0.0:1788863562.085750:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.085763:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c2e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863562.085790:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863562.085889:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3642:x1875759226462464:12345-0@lo:103: Request processed in 1049us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863562.085898:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788863562.086041:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226462464:0@lo:103: 00080000:10000000:2.0:1788863562.089009:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788863562.089521:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788863562.089775:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788863562.093916:0:9528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788863562.115510:0:9528:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788863562.115525:0:9528:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788863562.115616:0:9528:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788863562.115686:0:9528:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788863562.115714:0:9528:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788863562.115749:0:9528:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788863562.119611:0:9528:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863562.128003:0:9528:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788863562.220279:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226462592:0@lo:41: 00000100:00100000:0.0:1788863562.220395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863562.220431:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226462720:0@lo:41: 00000100:00100000:3.0:1788863562.220473:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863562.220538:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462592 00000100:00100000:3.0:1788863562.220548:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462592 00000100:00100000:3.0:1788863562.220596:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462720 00000100:00100000:3.0:1788863562.220599:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462720 00000100:00100000:3.0:1788863562.220618:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863562.220628:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226462592:12345-0@lo:41: 00000004:00000024:3.0:1788863562.220674:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788863562.220734:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226462592:12345-0@lo:41: Request processed in 107us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863562.220741:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863562.220762:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863562.220768:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226462720:12345-0@lo:41: 00000004:00000024:3.0:1788863562.220789:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788863562.220821:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226462720:12345-0@lo:41: Request processed in 54us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863562.220827:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863562.220875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226462720:0@lo:41: 00000100:00100000:3.0:1788863562.220923:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226462592:0@lo:41: 00010000:00010000:2.0:1788863562.926706:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863563.216025:0:9601:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863563.218495:0:9601:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788863563.953102:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863564.971457:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863565.803431:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226462848:0@lo:13: 00000100:00100000:3.0:1788863565.803763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863565.805143:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462848 00000100:00100000:0.0:1788863565.805159:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462848 00000100:00100000:1.0:1788863565.806368:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863565.806397:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226462976:0@lo:13: 00000100:00080000:3.0:1788863565.807021:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863565.807060:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863565.807116:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226462848:12345-0@lo:13: 00002000:00000024:3.0:1788863565.807165:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863565.807258:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226462848:12345-0@lo:13: Request processed in 186us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863565.807265:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788863565.807333:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af54a80 x1875759226462848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863565.808656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863565.809439:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226462848:0@lo:13: 00000100:00100000:1.0:1788863565.810371:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226462976 00000100:00100000:1.0:1788863565.810387:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226462976 00000100:00080000:3.0:1788863565.811570:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863565.813134:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863565.813169:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226462976:12345-0@lo:13: 00002000:00000024:1.0:1788863565.813208:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863565.813331:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226462976:12345-0@lo:13: Request processed in 180us (4680us total) trans 0 rc 0/0 00010000:00080000:3.0:1788863565.813429:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af54380 x1875759226462976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863565.813457:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226462976:0@lo:13: 00000100:00100000:1.0:1788863565.813692:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788863565.998528:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863567.019900:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863567.339408:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863567.339450:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226463104:0@lo:41: 00000100:00100000:1.0:1788863567.339502:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226463232:0@lo:41: 00000100:00100000:3.0:1788863567.339551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863567.339641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863567.339746:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226463104 00000100:00100000:1.0:1788863567.339756:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226463232 00000100:00100000:0.0:1788863567.339763:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226463104 00000100:00100000:1.0:1788863567.339767:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226463232 00000100:00100000:1.0:1788863567.339824:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863567.339834:0:6542:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788863567.339838:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226463232:12345-0@lo:41: 00000100:00100000:0.0:1788863567.339848:0:6542:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:1.0:1788863567.339890:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788863567.340209:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788863567.340222:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226463104:12345-0@lo:41: 00000100:00100000:1.0:1788863567.340284:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226463232:12345-0@lo:41: Request processed in 447us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863567.340295:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00000024:0.0:1788863567.340463:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788863567.340505:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226463104:12345-0@lo:41: Request processed in 286us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863567.340512:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863567.340608:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226463104:0@lo:41: 00000100:00100000:1.0:1788863567.341212:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226463232:0@lo:41: 00000100:00100000:1.0:1788863567.341237:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863567.341250:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226463360:0@lo:400: 00000100:00100000:1.0:1788863567.341306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863567.341440:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226463360 00000100:00100000:1.0:1788863567.341447:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226463360 00000100:00100000:1.0:1788863567.341575:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788863567.341585:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3640:x1875759226463360:12345-0@lo:400: 00000100:00100000:1.0:1788863567.341635:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3640:x1875759226463360:12345-0@lo:400: Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863567.341654:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788863567.341686:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863567.341695:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226463488:0@lo:400: 00000100:00100000:1.0:1788863567.341785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863567.341823:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226463616:0@lo:400: 00000100:00100000:1.0:1788863567.341847:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863567.341862:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226463744:0@lo:400: 00000100:00100000:1.0:1788863567.341869:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226464128:0@lo:400: 00000100:00100000:0.0:1788863567.341908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863567.341913:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863567.341940:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863567.341947:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226464000:0@lo:400: 00000100:00100000:1.0:1788863567.341967:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863567.342165:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226464256:0@lo:400: 00000100:00100000:0.0:1788863567.342198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863567.342220:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226463360:0@lo:400: 00000100:00100000:0.0:1788863567.342236:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788863567.342242:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226463872:0@lo:400: 00000100:00100000:0.0:1788863567.342286:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863567.342298:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226464384:0@lo:400: 00000100:00100000:0.0:1788863567.342321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863567.342591:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226463488 00000100:00100000:2.0:1788863567.342599:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226463488 00000100:00100000:2.0:1788863567.342631:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226463616 00000100:00100000:2.0:1788863567.342634:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226463616 00000100:00100000:2.0:1788863567.342647:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226463744 00000100:00100000:2.0:1788863567.342649:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226463744 00000100:00100000:2.0:1788863567.342688:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464256 00000100:00100000:2.0:1788863567.342692:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464256 00000100:00100000:2.0:1788863567.342705:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226463872 00000100:00100000:2.0:1788863567.342707:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226463872 00000100:00100000:2.0:1788863567.342721:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464384 00000100:00100000:2.0:1788863567.342724:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464384 00000100:00100000:2.0:1788863567.342738:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863567.342746:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226463488:12345-0@lo:400: 00000100:00100000:2.0:1788863567.342795:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226463488:12345-0@lo:400: Request processed in 50us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863567.342801:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863567.342818:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788863567.342824:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226463616:12345-0@lo:400: 00000100:00100000:2.0:1788863567.342852:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226463616:12345-0@lo:400: Request processed in 29us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863567.342858:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788863567.342872:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788863567.342878:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226463744:12345-0@lo:400: 00000100:00100000:2.0:1788863567.342923:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226463744:12345-0@lo:400: Request processed in 45us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863567.342929:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788863567.342942:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788863567.342948:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226464256:12345-0@lo:400: 00000100:00100000:2.0:1788863567.342978:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226464256:12345-0@lo:400: Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863567.342984:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788863567.342998:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788863567.343005:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226463872:12345-0@lo:400: 00000100:00100000:2.0:1788863567.343038:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226463872:12345-0@lo:400: Request processed in 35us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863567.343044:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788863567.343057:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863567.343063:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226464384:12345-0@lo:400: 00010000:00080000:1.0:1788863567.343650:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438dea00 x1875759226463616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863567.343666:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226463616:0@lo:400: 00010000:00080000:1.0:1788863567.343682:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438dd880 x1875759226463488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863567.343691:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226463488:0@lo:400: 00000100:00100000:2.0:1788863567.344275:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226464384:12345-0@lo:400: Request processed in 1209us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863567.344284:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863567.344326:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464128 00000100:00100000:2.0:1788863567.344332:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464128 00000100:00100000:2.0:1788863567.344652:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464000 00000100:00100000:2.0:1788863567.344657:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464000 00000100:00080000:0.0:1788863567.344756:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863567.344762:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863567.344764:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863567.353357:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863567.353384:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226464128:12345-0@lo:400: 00000100:00100000:1.0:1788863567.353508:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226464128:12345-0@lo:400: Request processed in 138us (11597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863567.353517:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788863567.353583:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438ded80 x1875759226464128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863567.353618:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226464128:0@lo:400: 00000100:00100000:1.0:1788863567.353651:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863567.353659:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226464000:12345-0@lo:400: 00000100:00100000:1.0:1788863567.353696:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226464000:12345-0@lo:400: Request processed in 39us (11729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863567.353703:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788863567.353727:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438dc380 x1875759226464000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863567.353737:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226464000:0@lo:400: 00010000:00080000:2.0:1788863567.354580:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438dca80 x1875759226463872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863567.354594:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226463872:0@lo:400: 00010000:00080000:2.0:1788863567.355592:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438de680 x1875759226464384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863567.355818:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226464384:0@lo:400: 00010000:00080000:2.0:1788863567.355841:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438df800 x1875759226463744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863567.355850:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226463744:0@lo:400: 00010000:00080000:2.0:1788863567.355868:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438df480 x1875759226464256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863567.355876:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226464256:0@lo:400: 00010000:00010000:0.0:1788863568.043611:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863569.069685:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788863569.166718:0:9892:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788863570.092310:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788863570.108757:0:9944:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788863570.108983:0:9944:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788863570.923772:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226464512:0@lo:13: 00000100:00100000:2.0:1788863570.923856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863570.924095:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226464640:0@lo:13: 00000100:00100000:1.0:1788863570.924154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863570.924201:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464512 00000100:00100000:1.0:1788863570.924208:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464512 00000100:00100000:1.0:1788863570.924252:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464640 00000100:00100000:1.0:1788863570.924255:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464640 00000100:00100000:1.0:1788863570.924272:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863570.924281:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226464512:12345-0@lo:13: 00002000:00000024:1.0:1788863570.924311:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863570.924355:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226464512:12345-0@lo:13: Request processed in 75us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863570.924362:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863570.924381:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863570.924387:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226464640:12345-0@lo:13: 00002000:00000024:1.0:1788863570.924405:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863570.924435:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226464640:12345-0@lo:13: Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863570.924442:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788863570.924458:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863570.924484:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af54e00 x1875759226464640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863570.924501:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226464640:0@lo:13: 00010000:00080000:2.0:1788863570.924730:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438df480 x1875759226464512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863570.924745:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226464512:0@lo:13: 00010000:00010000:0.0:1788863571.115352:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788863571.437674:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788863571.437682:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e67afa4000 from 39 10000000:01000000:3.0:1788863571.437688:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788863571.437738:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.437767:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.437780:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863571.437805:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226464768:0@lo:101: 00000100:00100000:3.0:1788863571.437877:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.437980:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5428603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.438130:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464768 00000100:00100000:2.0:1788863571.438138:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464768 00000100:00100000:2.0:1788863571.438247:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788863571.438257:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226464768:12345-0@lo:101: 00010000:00010000:2.0:1788863571.438269:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863571.438282:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68c35 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.438306:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.438328:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.438337:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98e00, rc 0) 00000100:00100000:2.0:1788863571.438390:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226464768:12345-0@lo:101: Request processed in 134us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.438396:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788863571.439991:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226464768:0@lo:101: 00010000:00010000:3.0:1788863571.440020:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.440034:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863571.440147:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226464896:0@lo:501: 00000100:00100000:3.0:1788863571.440216:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.440276:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5428603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.440347:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226464896 00000100:00100000:0.0:1788863571.440355:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226464896 00000100:00100000:0.0:1788863571.440408:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788863571.440417:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226464896:12345-0@lo:501: 00000100:00100000:0.0:1788863571.440560:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226464896:12345-0@lo:501: Request processed in 143us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.440597:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788863571.440895:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226464896:0@lo:501: 00000100:00100000:3.0:1788863571.440944:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465024:0@lo:503: 00000100:00100000:3.0:1788863571.440989:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.441014:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5428603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.441287:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465024 00000100:00100000:0.0:1788863571.441293:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465024 00000100:00100000:0.0:1788863571.441330:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788863571.441339:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226465024:12345-0@lo:503: 00000100:00100000:0.0:1788863571.441438:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226465024:12345-0@lo:503: Request processed in 100us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.441445:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788863571.441703:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465024:0@lo:503: 00000100:00100000:3.0:1788863571.444976:0:9996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9996:1875759226465152:0@lo:502: 00000100:00100000:3.0:1788863571.445115:0:9996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.446582:0:9996:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.446716:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465152 00000100:00100000:1.0:1788863571.446727:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465152 00000100:00100000:1.0:1788863571.446851:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788863571.446861:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9996:x1875759226465152:12345-0@lo:502: 00000100:00100000:1.0:1788863571.447025:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9996:x1875759226465152:12345-0@lo:502: Request processed in 164us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.447032:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788863571.447133:0:9996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9996:1875759226465152:0@lo:502: 00000100:00100000:3.0:1788863571.447221:0:9996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9996:1875759226465280:0@lo:502: 00000100:00100000:3.0:1788863571.447272:0:9996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.448066:0:9996:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658714e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.448188:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465280 00000100:00100000:0.0:1788863571.448202:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465280 00000100:00100000:0.0:1788863571.448239:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863571.448247:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9996:x1875759226465280:12345-0@lo:502: 00000100:00100000:3.0:1788863571.448707:0:9996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9996:1875759226465280:0@lo:502: 00000040:00080000:3.0:1788863571.448741:0:9996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:0.0:1788863571.448911:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:9996:x1875759226465280:12345-0@lo:502: Request processed in 664us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.448920:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000020:01000000:1.0:1788863571.449001:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788863571.449021:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788863571.449031:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.449043:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863571.449052:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788863571.449055:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788863571.449058:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863571.450292:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.450323:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.450335:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863571.450358:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465408:0@lo:101: 00000100:00100000:1.0:1788863571.450416:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.450462:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.450596:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465408 00000100:00100000:0.0:1788863571.451889:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465408 00000100:00100000:0.0:1788863571.451966:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788863571.451976:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226465408:12345-0@lo:101: 00010000:00010000:0.0:1788863571.451996:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863571.452012:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68c43 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.452051:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.452062:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.452102:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030800, rc 0) 00000100:00100000:0.0:1788863571.452590:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226465408:12345-0@lo:101: Request processed in 614us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.452598:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788863571.452851:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465408:0@lo:101: 00010000:00010000:1.0:1788863571.452881:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.452893:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863571.452978:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465536:0@lo:501: 00000100:00100000:1.0:1788863571.453018:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.453070:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.453376:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465536 00000100:00100000:2.0:1788863571.453382:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465536 00000100:00100000:2.0:1788863571.453456:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788863571.453465:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226465536:12345-0@lo:501: 00000100:00100000:2.0:1788863571.453613:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226465536:12345-0@lo:501: Request processed in 149us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.453620:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788863571.453686:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465536:0@lo:501: 00000100:00100000:1.0:1788863571.453715:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465664:0@lo:503: 00000100:00100000:1.0:1788863571.453760:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.456369:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.456979:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465664 00000100:00100000:3.0:1788863571.456989:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465664 00000100:00100000:0.0:1788863571.457055:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788863571.457071:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226465664:12345-0@lo:503: 00000100:00100000:0.0:1788863571.457404:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226465664:12345-0@lo:503: Request processed in 336us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.457472:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226465664:0@lo:503: 00000100:00100000:0.0:1788863571.458885:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788863571.459626:0:9997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9997:1875759226465792:0@lo:502: 00000100:00100000:1.0:1788863571.459913:0:9997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.459988:0:9997:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.460025:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465792 00000100:00100000:2.0:1788863571.460032:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465792 00000100:00100000:2.0:1788863571.460401:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788863571.460413:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9997:x1875759226465792:12345-0@lo:502: 00000100:00100000:2.0:1788863571.460564:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:9997:x1875759226465792:12345-0@lo:502: Request processed in 154us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.460626:0:9997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9997:1875759226465792:0@lo:502: 00000020:01000000:1.0:1788863571.460877:0:9997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863571.460886:0:9997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863571.460889:0:9997:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788863571.460892:0:9997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788863571.460894:0:9997:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788863571.460913:0:9997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9997:1875759226465920:0@lo:502: 00000100:00100000:1.0:1788863571.460946:0:9997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.460977:0:9997:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.461020:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226465920 00000100:00100000:3.0:1788863571.461024:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226465920 00000100:00100000:3.0:1788863571.461102:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788863571.461109:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:9997:x1875759226465920:12345-0@lo:502: 00000100:00100000:3.0:1788863571.461187:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:9997:x1875759226465920:12345-0@lo:502: Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.461194:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788863571.461257:0:9997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9997:1875759226465920:0@lo:502: 00000020:01000000:1.0:1788863571.461273:0:9997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863571.461277:0:9997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863571.461278:0:9997:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788863571.461281:0:9997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000100:00100000:2.0:1788863571.461418:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000020:01000000:3.0:1788863571.461559:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788863571.461579:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788863571.461588:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.461600:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863571.461610:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788863571.461612:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e648f4b800 from 39 10000000:01000000:3.0:1788863571.461621:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788863571.461865:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.461875:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.461886:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863571.461901:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466048:0@lo:101: 00000100:00100000:3.0:1788863571.461933:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.462009:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.462045:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466048 00000100:00100000:2.0:1788863571.462050:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466048 00000100:00100000:2.0:1788863571.462107:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788863571.462116:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226466048:12345-0@lo:101: 00010000:00010000:2.0:1788863571.462125:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863571.462145:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68c51 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.462168:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.462291:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.462301:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98a00, rc 0) 00000100:00100000:2.0:1788863571.462347:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226466048:12345-0@lo:101: Request processed in 233us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.462353:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788863571.462423:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466048:0@lo:101: 00010000:00010000:1.0:1788863571.462436:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.462445:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863571.462497:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466176:0@lo:501: 00000100:00100000:1.0:1788863571.462523:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.462546:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.462612:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466176 00000100:00100000:3.0:1788863571.462616:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466176 00000100:00100000:3.0:1788863571.462636:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788863571.462652:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226466176:12345-0@lo:501: 00000100:00100000:3.0:1788863571.462917:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226466176:12345-0@lo:501: Request processed in 274us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.462924:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788863571.463056:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466176:0@lo:501: 00000100:00100000:1.0:1788863571.463136:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466304:0@lo:503: 00000100:00100000:1.0:1788863571.463189:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.463215:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.463319:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466304 00000100:00100000:2.0:1788863571.463324:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466304 00000100:00100000:2.0:1788863571.463345:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788863571.463350:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226466304:12345-0@lo:503: 00000100:00100000:2.0:1788863571.463438:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226466304:12345-0@lo:503: Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.463444:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788863571.463698:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466304:0@lo:503: 00000100:00100000:3.0:1788863571.464307:0:9998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9998:1875759226466432:0@lo:502: 00000100:00100000:3.0:1788863571.464353:0:9998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.464388:0:9998:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.464433:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466432 00000100:00100000:2.0:1788863571.464438:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466432 00000100:00100000:2.0:1788863571.464470:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788863571.464477:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:9998:x1875759226466432:12345-0@lo:502: 00000100:00100000:2.0:1788863571.464580:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:9998:x1875759226466432:12345-0@lo:502: Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.464586:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788863571.464671:0:9998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9998:1875759226466432:0@lo:502: 00000100:00100000:1.0:1788863571.464726:0:9998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9998:1875759226466560:0@lo:502: 00000100:00100000:1.0:1788863571.465013:0:9998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.465036:0:9998:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ed3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.465104:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466560 00000100:00100000:2.0:1788863571.465108:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466560 00000100:00100000:2.0:1788863571.465133:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788863571.465139:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:9998:x1875759226466560:12345-0@lo:502: 00000100:00100000:2.0:1788863571.465218:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:9998:x1875759226466560:12345-0@lo:502: Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.465224:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788863571.465305:0:9998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9998:1875759226466560:0@lo:502: 00000040:00080000:1.0:1788863571.465324:0:9998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788863571.465484:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788863571.465506:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863571.465515:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.465525:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863571.465534:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863571.465537:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e648f4b800 from 6 10000000:01000000:2.0:1788863571.465539:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863571.465565:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.465573:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.465583:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863571.465597:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466688:0@lo:101: 00000100:00100000:2.0:1788863571.465625:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.465666:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.465980:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466688 00000100:00100000:3.0:1788863571.465985:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466688 00000100:00100000:3.0:1788863571.466010:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788863571.466017:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226466688:12345-0@lo:101: 00010000:00010000:3.0:1788863571.466026:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863571.466051:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68c5f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.466071:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68c5f expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.466106:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c5f expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.466115:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d000, rc 0) 00000100:00100000:3.0:1788863571.466146:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226466688:12345-0@lo:101: Request processed in 129us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.466150:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788863571.466269:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466688:0@lo:101: 00010000:00010000:2.0:1788863571.466292:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.466301:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863571.466346:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466816:0@lo:256: 00000100:00100000:2.0:1788863571.466377:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.466407:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.466453:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466816 00000100:00100000:3.0:1788863571.466457:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466816 00000100:00100000:3.0:1788863571.466483:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788863571.466489:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226466816:12345-0@lo:256: 20000000:01000000:3.0:1788863571.466502:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788863571.466517:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788863571.466524:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788863571.466602:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226466816:12345-0@lo:256: Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.466609:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788863571.466938:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466816:0@lo:256: 10000000:01000000:2.0:1788863571.466981:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863571.466987:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.466994:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863571.467001:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788863571.467002:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788863571.467004:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788863571.467022:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.467028:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.467035:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863571.467056:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466944:0@lo:101: 00000100:00100000:2.0:1788863571.467589:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.467897:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.467937:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226466944 00000100:00100000:3.0:1788863571.467943:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226466944 00000100:00100000:3.0:1788863571.468016:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788863571.468025:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226466944:12345-0@lo:101: 00010000:00010000:3.0:1788863571.468035:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863571.468047:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68c6d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.468112:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.468123:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.468130:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167ce00, rc 0) 00000100:00100000:3.0:1788863571.468184:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226466944:12345-0@lo:101: Request processed in 151us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.468190:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788863571.468288:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226466944:0@lo:101: 00010000:00010000:2.0:1788863571.468302:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.468310:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863571.468373:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226467072:0@lo:501: 00000100:00100000:2.0:1788863571.468399:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.468531:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.468606:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467072 00000100:00100000:1.0:1788863571.468611:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467072 00000100:00100000:1.0:1788863571.468634:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788863571.468640:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226467072:12345-0@lo:501: 00000100:00100000:1.0:1788863571.468807:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226467072:12345-0@lo:501: Request processed in 166us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.468814:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788863571.468929:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226467072:0@lo:501: 00000100:00100000:2.0:1788863571.468956:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226467200:0@lo:503: 00000100:00100000:2.0:1788863571.468994:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.469016:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.469060:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467200 00000100:00100000:1.0:1788863571.469064:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467200 00000100:00100000:1.0:1788863571.469099:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788863571.469104:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226467200:12345-0@lo:503: 00000100:00100000:1.0:1788863571.469208:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226467200:12345-0@lo:503: Request processed in 103us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.469214:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788863571.469294:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226467200:0@lo:503: 00000100:00100000:2.0:1788863571.469626:0:9999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9999:1875759226467328:0@lo:502: 00000100:00100000:2.0:1788863571.469661:0:9999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.469692:0:9999:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.469736:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467328 00000100:00100000:1.0:1788863571.469745:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467328 00000100:00100000:1.0:1788863571.469764:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788863571.469781:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:9999:x1875759226467328:12345-0@lo:502: 00000100:00100000:1.0:1788863571.469859:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:9999:x1875759226467328:12345-0@lo:502: Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.469866:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788863571.470001:0:9999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9999:1875759226467328:0@lo:502: 00000020:01000000:2.0:1788863571.470025:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788863571.470033:0:9999:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788863571.470046:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863571.470048:0:9999:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788863571.470052:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788863571.470056:0:9999:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1788863571.470111:0:9999:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788863571.470114:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863571.470129:0:9999:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff89e5428ecd40) 00000020:00000080:2.0:1788863571.470151:0:9999:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788863571.470156:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788863571.470243:0:9999:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788863571.470249:0:9999:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788863571.470266:0:9999:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b68c82 00010000:00080000:2.0:1788863571.470294:0:9999:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e54399c000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863571.470567:0:9999:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788863571.470706:0:9999:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788863571.470717:0:9999:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788863571.470908:0:9999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863571.471021:0:9999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863571.471191:0:9999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788863571.471283:0:9999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788863571.472386:0:10000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863571.472392:0:10000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788863571.473309:0:9999:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788863571.473321:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788863571.473359:0:9999:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788863571.473384:0:9999:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b68c89 00000100:00080000:2.0:1788863571.473394:0:9999:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863571.473404:0:9999:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e54399c000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863571.473440:0:9999:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e655c45500 x1875759226467456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863571.473475:0:9999:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788863571.473533:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863571.473538:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863571.473540:0:9999:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788863571.473543:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863571.473547:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863571.473548:0:9999:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788863571.473551:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788863571.473553:0:9999:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788863571.473582:0:9999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9999:1875759226467584:0@lo:502: 00000100:00100000:2.0:1788863571.473673:0:9999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.473721:0:9999:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.473913:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226467456:0@lo:8: 00000100:00100000:1.0:1788863571.473948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.473984:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467584 00000100:00100000:1.0:1788863571.473991:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467584 00000100:00100000:1.0:1788863571.474023:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788863571.474032:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:9999:x1875759226467584:12345-0@lo:502: 00000100:00100000:1.0:1788863571.474155:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:9999:x1875759226467584:12345-0@lo:502: Request processed in 124us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.474163:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788863571.474215:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467456 00000100:00100000:1.0:1788863571.474219:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467456 00000100:00100000:1.0:1788863571.474241:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863571.474246:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226467456:12345-0@lo:8: 00010000:00080000:1.0:1788863571.474270:0:8452:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1788863571.474297:0:8452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b68c90 00002000:00100000:1.0:1788863571.474312:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff89e54343a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788863571.474316:0:8452:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788863571.474319:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788863571.474379:0:8452:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788863571.474605:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788863571.474635:0:8452:0:(import.c:65:import_set_state_nolock()) ffff89e54343d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863571.474677:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226467456:12345-0@lo:8: Request processed in 429us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.474684:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788863571.474722:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e655c45500 x1875759226467456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863571.474732:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863571.474964:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788863571.474974:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788863571.474979:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788863571.474983:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e54399c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788863571.474992:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788863571.474997:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226467456:0@lo:8: 00000100:00100000:1.0:1788863571.475047:0:10001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226467712:0@lo:700: 00000100:00100000:1.0:1788863571.475096:0:10001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.475123:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467712 00000100:00100000:1.0:1788863571.475127:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467712 00000100:00100000:1.0:1788863571.475164:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863571.475170:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10001:x1875759226467712:12345-0@lo:700: 00000100:00100000:1.0:1788863571.475209:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8460:1875759226467840:0@lo:700: 00000100:00100000:1.0:1788863571.475237:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.475259:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67568a180 going to sleep for 11 seconds 00000100:00080000:1.0:1788863571.475271:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863571.475282:0:6543:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467840 00000100:00100000:1.0:1788863571.475285:0:6543:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467840 00000100:00100000:1.0:1788863571.475322:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863571.475329:0:6543:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8460:x1875759226467840:12345-0@lo:700: 00000100:00080000:1.0:1788863571.475469:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863571.475477:0:10001:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67568a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.475671:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226467968:0@lo:400: 00000100:00100000:3.0:1788863571.475757:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788863571.475996:0:10000:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788863571.476049:0:10000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 238599972312ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788863571.476056:0:10000:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788863571.476384:0:9999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:9999:1875759226467584:0@lo:502: 00000020:01000000:2.0:1788863571.476423:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863571.476431:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863571.476432:0:9999:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788863571.476437:0:9999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1788863571.476631:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226468480:0@lo:400: 00000100:00100000:3.0:1788863571.476668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.476706:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788863571.476713:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226468096:0@lo:400: 00000100:00100000:3.0:1788863571.476745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.476763:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226468608:0@lo:400: 00000100:00100000:3.0:1788863571.476925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.476954:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226468224:0@lo:400: 00000100:00100000:3.0:1788863571.476975:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.476984:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226468736:0@lo:400: 00000100:00100000:3.0:1788863571.476998:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.477007:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863571.477012:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226468352:0@lo:400: 00000100:00100000:3.0:1788863571.477036:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.477061:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226467968 00000100:00100000:3.0:1788863571.477065:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226467968 00000100:00100000:3.0:1788863571.477113:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468480 00000100:00100000:3.0:1788863571.477115:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468480 00000100:00100000:3.0:1788863571.477132:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468608 00000100:00100000:3.0:1788863571.477134:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468608 00000100:00100000:3.0:1788863571.477144:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468224 00000100:00100000:3.0:1788863571.477146:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468224 00000100:00100000:3.0:1788863571.477153:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468736 00000100:00100000:3.0:1788863571.477155:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468736 00000100:00100000:3.0:1788863571.477166:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863571.477182:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226467968:12345-0@lo:400: 00000100:00100000:3.0:1788863571.477231:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226467968:12345-0@lo:400: Request processed in 58us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.477239:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863571.477253:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863571.477260:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226468480:12345-0@lo:400: 00000100:00100000:3.0:1788863571.477286:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226468480:12345-0@lo:400: Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.477292:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863571.477301:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863571.477306:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226468608:12345-0@lo:400: 00000100:00100000:3.0:1788863571.477327:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226468608:12345-0@lo:400: Request processed in 21us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.477332:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863571.477341:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863571.477346:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226468224:12345-0@lo:400: 00000100:00100000:3.0:1788863571.477383:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226468224:12345-0@lo:400: Request processed in 36us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.477389:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863571.477400:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863571.477406:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226468736:12345-0@lo:400: 00000100:00100000:3.0:1788863571.477443:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226468736:12345-0@lo:400: Request processed in 37us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.477449:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863571.477469:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468096 00000100:00100000:3.0:1788863571.477473:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468096 00000100:00100000:3.0:1788863571.477495:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468352 00000100:00100000:3.0:1788863571.477498:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468352 00000100:00100000:3.0:1788863571.477510:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788863571.477515:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226468096:12345-0@lo:400: 00000100:00100000:3.0:1788863571.477546:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226468096:12345-0@lo:400: Request processed in 30us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.477552:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788863571.477561:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863571.477567:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226468352:12345-0@lo:400: 00000100:00100000:3.0:1788863571.477592:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226468352:12345-0@lo:400: Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.477597:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863571.477624:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226468096:0@lo:400: 00010000:00080000:3.0:1788863571.477636:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676156680 x1875759226468608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.477646:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226468608:0@lo:400: 00010000:00080000:3.0:1788863571.477664:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef4a80 x1875759226467968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.477673:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226467968:0@lo:400: 00010000:00080000:3.0:1788863571.477681:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676157800 x1875759226468480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.477688:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226468480:0@lo:400: 00000100:00100000:3.0:1788863571.477718:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226468352:0@lo:400: 00010000:00080000:3.0:1788863571.477726:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676156300 x1875759226468224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.477734:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226468224:0@lo:400: 00000020:01000000:1.0:1788863571.478087:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788863571.478111:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788863571.478121:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.478132:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863571.478143:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788863571.478146:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e64a89a800 from 39 10000000:01000000:1.0:1788863571.478149:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863571.478188:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.478195:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.478205:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863571.478222:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226468864:0@lo:101: 00000100:00100000:1.0:1788863571.478271:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.478303:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67568a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.478397:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468864 00000100:00100000:1.0:1788863571.478401:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468864 00000100:00100000:1.0:1788863571.478424:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788863571.478430:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226468864:12345-0@lo:101: 00010000:00010000:1.0:1788863571.478446:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863571.478457:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68c97 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.478477:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.478487:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.478494:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114a00, rc 0) 00000100:00100000:1.0:1788863571.478519:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226468864:12345-0@lo:101: Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.478525:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788863571.478554:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226468864:0@lo:101: 00010000:00010000:1.0:1788863571.478566:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.478575:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863571.478638:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226468992:0@lo:501: 00010000:00080000:3.0:1788863571.479254:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676155500 x1875759226468736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.479267:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226468736:0@lo:400: 00000100:00080000:3.0:1788863571.479306:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863571.479312:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863571.479579:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.479655:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67568a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.480300:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226468992 00000100:00100000:2.0:1788863571.480309:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226468992 00000100:00100000:2.0:1788863571.480388:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788863571.480396:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226468992:12345-0@lo:501: 00000100:00100000:2.0:1788863571.480539:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226468992:12345-0@lo:501: Request processed in 144us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.480546:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788863571.480608:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226468992:0@lo:501: 00000100:00100000:1.0:1788863571.480670:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469120:0@lo:503: 00000100:00100000:1.0:1788863571.480724:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.495117:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226469120 00000100:00100000:3.0:1788863571.495135:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226469120 00000100:00100000:3.0:1788863571.495299:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788863571.495312:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226469120:12345-0@lo:503: 00000100:00100000:3.0:1788863571.495778:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226469120:12345-0@lo:503: Request processed in 469us (15052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.495854:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788863571.495941:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67568a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.495972:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469120:0@lo:503: 00000004:00080000:2.0:1788863571.499561:0:7467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788863571.500610:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10002:1875759226469248:0@lo:502: 00000100:00100000:1.0:1788863571.500719:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.500788:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6487a3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.500843:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226469248 00000100:00100000:2.0:1788863571.500852:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226469248 00000100:00100000:2.0:1788863571.500906:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788863571.500924:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10002:x1875759226469248:12345-0@lo:502: 00000100:00100000:2.0:1788863571.501058:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10002:x1875759226469248:12345-0@lo:502: Request processed in 136us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.501237:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788863571.501370:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10002:1875759226469248:0@lo:502: 00000100:00100000:1.0:1788863571.501441:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10002:1875759226469376:0@lo:502: 00000100:00100000:1.0:1788863571.501484:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.501526:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.501531:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226469376 00000100:00100000:3.0:1788863571.501538:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226469376 00000100:00100000:3.0:1788863571.501582:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788863571.501590:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10002:x1875759226469376:12345-0@lo:502: 00000100:00100000:3.0:1788863571.501696:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10002:x1875759226469376:12345-0@lo:502: Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.501704:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788863571.502014:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10002:1875759226469376:0@lo:502: 00000040:00080000:1.0:1788863571.502038:0:10002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788863571.502339:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788863571.502362:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863571.502374:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.502386:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863571.502396:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863571.502399:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e64a89a800 from 6 10000000:01000000:2.0:1788863571.502402:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863571.502432:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.502439:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.502448:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863571.502464:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469504:0@lo:101: 00000100:00100000:2.0:1788863571.502504:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.502530:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.502587:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226469504 00000100:00100000:3.0:1788863571.502592:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226469504 00000100:00100000:3.0:1788863571.502627:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788863571.502635:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226469504:12345-0@lo:101: 00010000:00010000:3.0:1788863571.502654:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863571.502667:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167c400/0xf569beb9d4b68cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68ca5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.502702:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167c400/0xf569beb9d4b68cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68ca5 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.502713:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167c400/0xf569beb9d4b68cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68ca5 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.502722:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167c400, rc 0) 00000100:00100000:3.0:1788863571.502763:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226469504:12345-0@lo:101: Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.502778:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788863571.503382:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469504:0@lo:101: 00010000:00010000:2.0:1788863571.503398:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.503409:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863571.503467:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469632:0@lo:256: 00000100:00100000:2.0:1788863571.503514:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.503545:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788863571.503561:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226469632 00000100:00100000:2.0:1788863571.503571:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226469632 00000100:00100000:2.0:1788863571.503609:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788863571.503618:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226469632:12345-0@lo:256: 20000000:01000000:2.0:1788863571.503635:0:6532:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788863571.503667:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788863571.503670:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 40000000:02000000:0.0:1788863571.503757:0:6543:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788863571.503998:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226469632:12345-0@lo:256: Request processed in 380us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.504006:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788863571.504025:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469632:0@lo:256: 10000000:01000000:1.0:1788863571.504119:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788863571.504127:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.504138:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863571.504147:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788863571.504149:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788863571.504152:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863571.504187:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.504196:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.504217:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863571.504232:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469760:0@lo:101: 00000100:00100000:1.0:1788863571.504264:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.504309:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6487a3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.504671:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226469760 00000100:00100000:3.0:1788863571.504677:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226469760 00000100:00100000:3.0:1788863571.504721:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788863571.504728:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226469760:12345-0@lo:101: 00010000:00010000:3.0:1788863571.504748:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863571.504766:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68cb3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.504800:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.504811:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.504819:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d400, rc 0) 00000100:00100000:3.0:1788863571.504866:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226469760:12345-0@lo:101: Request processed in 139us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.504872:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788863571.505529:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469760:0@lo:101: 00010000:00010000:1.0:1788863571.505552:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863571.505563:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863571.505633:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469888:0@lo:501: 00000100:00100000:1.0:1788863571.505676:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.505705:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6487a3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.508236:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226469888 00000100:00100000:3.0:1788863571.508251:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226469888 00000100:00100000:3.0:1788863571.508316:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788863571.508327:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226469888:12345-0@lo:501: 00000100:00100000:3.0:1788863571.508510:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226469888:12345-0@lo:501: Request processed in 185us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.508519:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788863571.509307:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226469888:0@lo:501: 00000100:00100000:2.0:1788863571.509382:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226470016:0@lo:503: 00000100:00100000:2.0:1788863571.509458:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.509513:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c657e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863571.509677:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470016 00000100:00100000:1.0:1788863571.509683:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470016 00000100:00100000:1.0:1788863571.509736:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788863571.509954:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226470016:12345-0@lo:503: 00000100:00100000:1.0:1788863571.510070:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226470016:12345-0@lo:503: Request processed in 118us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.510164:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226470016:0@lo:503: 00000100:00100000:2.0:1788863571.510385:0:10003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10003:1875759226470144:0@lo:502: 00000100:00100000:2.0:1788863571.510430:0:10003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.510458:0:10003:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c657e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.518453:0:6543:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8460:x1875759226467840:12345-0@lo:700: Request processed in 43112us (43203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.518469:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788863571.520094:0:8460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af55f80 x1875759226467840/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863571.520117:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8460:1875759226467840:0@lo:700: 40000000:02000000:0.0:1788863571.520135:0:8460:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1788863571.520605:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470144 00000100:00100000:3.0:1788863571.520615:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470144 00000100:00100000:3.0:1788863571.520670:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788863571.520680:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:10003:x1875759226470144:12345-0@lo:502: 00000100:00100000:3.0:1788863571.521030:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:10003:x1875759226470144:12345-0@lo:502: Request processed in 351us (10598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.521038:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788863571.521267:0:10003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10003:1875759226470144:0@lo:502: 00000020:01000000:3.0:1788863571.521311:0:10003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788863571.521321:0:10003:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788863571.521329:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863571.521331:0:10003:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788863571.521338:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788863571.521343:0:10003:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:3.0:1788863571.521365:0:10003:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788863571.521368:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:1.0:1788863571.522814:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000020:00000080:3.0:1788863571.524255:0:10003:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89e543a1b380) 00000020:00000080:2.0:1788863571.524335:0:10003:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788863571.524353:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788863571.524450:0:10003:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788863571.524458:0:10003:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788863571.524466:0:10003:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b68cc8 00010000:00080000:2.0:1788863571.524583:0:10003:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e543421000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863571.526391:0:10003:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788863571.527701:0:10003:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788863571.527720:0:10003:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788863571.528335:0:10003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863571.528495:0:10003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863571.530382:0:10003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788863571.530492:0:10003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788863571.532167:0:10004:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863571.532183:0:10004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788863571.534299:0:10003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863571.534315:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788863571.534371:0:10003:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788863571.534402:0:10003:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b68ccf 00000100:00080000:3.0:1788863571.534414:0:10003:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863571.534426:0:10003:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e543421000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863571.534466:0:10003:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543408380 x1875759226470272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863571.534510:0:10003:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788863571.534573:0:10003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863571.534578:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863571.534580:0:10003:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788863571.534584:0:10003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863571.534587:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863571.534589:0:10003:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863571.534592:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863571.534595:0:10003:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788863571.535000:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226470272:0@lo:8: 00000100:00100000:1.0:1788863571.535098:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.535192:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470272 00000100:00100000:1.0:1788863571.535216:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470272 00000100:00100000:1.0:1788863571.535251:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863571.535258:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226470272:12345-0@lo:8: 00010000:00080000:1.0:1788863571.535287:0:8451:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1788863571.535314:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b68cd6 00002000:00100000:1.0:1788863571.535328:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89e681a7d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788863571.535333:0:8451:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788863571.535336:0:8451:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788863571.535415:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788863571.535440:0:8451:0:(import.c:65:import_set_state_nolock()) ffff89e681a79000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863571.535504:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226470272:12345-0@lo:8: Request processed in 244us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.535511:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788863571.535552:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543408380 x1875759226470272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863571.535563:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863571.535572:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788863571.535580:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788863571.535585:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788863571.535588:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e543421000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788863571.535606:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788863571.535612:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226470272:0@lo:8: 00000100:00100000:3.0:1788863571.535714:0:10003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10003:1875759226470400:0@lo:502: 00000100:00100000:3.0:1788863571.535773:0:10003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.535820:0:10003:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a99c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788863571.535897:0:10004:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788863571.535960:0:10004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238659883247ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788863571.535968:0:10004:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788863571.536607:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470400 00000100:00100000:1.0:1788863571.536616:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470400 00000100:00100000:1.0:1788863571.536672:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788863571.536679:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10003:x1875759226470400:12345-0@lo:502: 00000100:00100000:1.0:1788863571.536941:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10003:x1875759226470400:12345-0@lo:502: Request processed in 261us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.536957:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788863571.540013:0:10003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10003:1875759226470400:0@lo:502: 00000020:01000000:3.0:1788863571.540096:0:10003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863571.540106:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863571.540108:0:10003:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788863571.540114:0:10003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788863571.540870:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788863571.540901:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788863571.540914:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.540927:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863571.540940:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788863571.540943:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89e671354d40 from 1 10000000:01000000:2.0:1788863571.540946:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788863571.540997:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.541005:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.541016:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863571.541038:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226470528:0@lo:101: 00000100:00100000:2.0:1788863571.541138:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.541191:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.541926:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470528 00000100:00100000:0.0:1788863571.541937:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470528 00000100:00100000:0.0:1788863571.541987:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788863571.541997:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226470528:12345-0@lo:101: 00010000:00010000:0.0:1788863571.542014:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863571.542032:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68cdd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.542103:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.542114:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.542122:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031c00, rc 0) 00000100:00100000:0.0:1788863571.542186:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226470528:12345-0@lo:101: Request processed in 190us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.542193:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788863571.542460:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226470528:0@lo:101: 00010000:00010000:0.0:1788863571.542477:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.542487:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863571.542572:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226470656:0@lo:501: 00000100:00100000:0.0:1788863571.543422:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863571.543473:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.543494:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470656 00000100:00100000:0.0:1788863571.543510:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470656 00000100:00100000:0.0:1788863571.543554:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788863571.543564:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226470656:12345-0@lo:501: 00000100:00100000:0.0:1788863571.544044:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226470656:12345-0@lo:501: Request processed in 481us (624us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863571.544132:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788863571.544330:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226470656:0@lo:501: 10000000:01000000:2.0:1788863571.544372:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788863571.544382:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863571.544392:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788863571.548390:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788863571.548404:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788863571.549019:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10001:x1875759226467712:12345-0@lo:700: Request processed in 73840us (73932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.549036:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788863571.549403:0:10001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af57100 x1875759226467712/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863571.549418:0:10001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226467712:0@lo:700: 00000004:00080000:2.0:1788863571.551485:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788863571.551936:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226470784:0@lo:13: 00000100:00100000:1.0:1788863571.552012:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.552128:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470784 00000100:00100000:2.0:1788863571.552136:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470784 00000100:00100000:2.0:1788863571.552219:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863571.552229:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226470784:12345-0@lo:13: 00002000:00000024:2.0:1788863571.552257:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000004:00080000:3.0:1788863571.552576:0:10005:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788863571.552615:0:10005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226470912:0@lo:7: 00000100:00100000:3.0:1788863571.552653:0:10005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863571.552675:0:10005:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.553229:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226470912 00000100:00100000:0.0:1788863571.553236:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226470912 00000100:00100000:0.0:1788863571.553682:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863571.553695:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10005:x1875759226470912:12345-0@lo:7: 00000100:00100000:2.0:1788863571.558261:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226470784:12345-0@lo:13: Request processed in 6021us (6237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863571.558300:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788863571.558349:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788863571.558656:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340ad80 x1875759226470784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863571.558681:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226470784:0@lo:13: 00000004:00080000:1.0:1788863571.565131:0:10001:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788863571.565164:0:10001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226471168:0@lo:7: 00000100:00100000:1.0:1788863571.565251:0:10001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.565294:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471168 00000100:00100000:1.0:1788863571.565301:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471168 00000100:00100000:1.0:1788863571.565348:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863571.565357:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10001:x1875759226471168:12345-0@lo:7: 00000100:00100000:1.0:1788863571.565447:0:10001:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.565537:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226471040:0@lo:13: 00000100:00100000:3.0:1788863571.565576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.565964:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471040 00000100:00100000:1.0:1788863571.565970:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471040 00000100:00100000:1.0:1788863571.566009:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863571.566017:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875759226471040:12345-0@lo:13: 00002000:00000024:1.0:1788863571.566033:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788863571.566108:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875759226471040:12345-0@lo:13: Request processed in 91us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.566115:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788863571.566168:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af55f80 x1875759226471040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863571.566200:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226471040:0@lo:13: 00002000:00080000:0.0:1788863571.569774:0:8452:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788863571.569785:0:8452:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788863571.569997:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10005:x1875759226470912:12345-0@lo:7: Request processed in 16300us (17337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.570009:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788863571.570773:0:10005:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340b480 x1875759226470912/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.570790:0:10005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226470912:0@lo:7: 00000004:00080000:3.0:1788863571.570805:0:10005:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788863571.570859:0:10005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226471296:0@lo:5: 00000100:00100000:2.0:1788863571.571771:0:10005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.573186:0:10005:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a99c0 going to sleep for 11 seconds 00002000:00080000:1.0:1788863571.575938:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788863571.575946:0:8451:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788863571.576038:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10001:x1875759226471168:12345-0@lo:7: Request processed in 10678us (10783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.576050:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863571.576325:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471296 00000100:00100000:1.0:1788863571.576332:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471296 00000100:00100000:3.0:1788863571.576429:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788863571.576441:0:10001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681e2f480 x1875759226471168/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.576442:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10005:x1875759226471296:12345-0@lo:5: 00000100:00100000:2.0:1788863571.576461:0:10001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226471168:0@lo:7: 00000004:00080000:2.0:1788863571.576475:0:10001:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00002000:00080000:3.0:1788863571.576477:0:8606:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788863571.576483:0:8606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788863571.576514:0:10001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226471424:0@lo:5: 00000100:00100000:2.0:1788863571.576590:0:10001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.576628:0:10001:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.576642:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471424 00000100:00100000:0.0:1788863571.576648:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471424 00000100:00100000:0.0:1788863571.576690:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863571.576698:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10001:x1875759226471424:12345-0@lo:5: 00002000:00080000:0.0:1788863571.576711:0:8450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788863571.576746:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10001:x1875759226471424:12345-0@lo:5: Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.576752:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788863571.576909:0:10001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e655c47480 x1875759226471424/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863571.576918:0:10001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c47480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226471424:0@lo:5: 00000004:00080000:2.0:1788863571.576927:0:10001:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788863571.576956:0:10001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226471552:0@lo:5: 00000100:00100000:2.0:1788863571.576982:0:10001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.577004:0:10001:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.577183:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10005:x1875759226471296:12345-0@lo:5: Request processed in 733us (5401us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788863571.577191:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788863571.577215:0:10005:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340b480 x1875759226471296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863571.577227:0:10005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226471296:0@lo:5: 00000004:00080000:2.0:1788863571.577236:0:10005:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788863571.577257:0:10005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226471680:0@lo:700: 00000100:00100000:2.0:1788863571.577294:0:10005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.577315:0:10005:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.577340:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471552 00000100:00100000:0.0:1788863571.577346:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471552 00000100:00100000:0.0:1788863571.577377:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863571.577384:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10001:x1875759226471552:12345-0@lo:5: 00002000:00080000:0.0:1788863571.577408:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788863571.579257:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471680 00000100:00100000:2.0:1788863571.579268:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471680 00000100:00100000:2.0:1788863571.579325:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863571.579335:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10005:x1875759226471680:12345-0@lo:700: 00000100:00100000:0.0:1788863571.580320:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10001:x1875759226471552:12345-0@lo:5: Request processed in 2932us (3333us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788863571.580340:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788863571.583387:0:10001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543442d80 x1875759226471552/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863571.583409:0:10001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10001:1875759226471552:0@lo:5: 00000004:00080000:3.0:1788863571.583436:0:10001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000001:00080000:0.0:1788863571.583882:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1788863571.583892:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788863571.584052:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10005:x1875759226471680:12345-0@lo:700: Request processed in 4717us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.584063:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788863571.584378:0:10005:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543443480 x1875759226471680/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863571.584388:0:10005:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788863571.584407:0:10005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226471680:0@lo:700: 00000100:00100000:2.0:1788863571.584900:0:10001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10001:1875759226471808:0@lo:900: 00000100:00100000:2.0:1788863571.584948:0:10001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863571.585014:0:10001:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.585056:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471808 00000100:00100000:0.0:1788863571.585063:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471808 00000100:00100000:1.0:1788863571.586411:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863571.586426:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10001:x1875759226471808:12345-0@lo:900: 00000100:00100000:1.0:1788863571.586530:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10001:x1875759226471808:12345-0@lo:900: Request processed in 109us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863571.586537:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788863571.586631:0:10001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543442680 x1875759226471808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863571.586645:0:10001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10001:1875759226471808:0@lo:900: 00000004:02000040:0.0:1788863571.587481:0:10005:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788863571.597690:0:10005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226471936:0@lo:5: 00000100:00100000:1.0:1788863571.597764:0:10005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863571.597811:0:10005:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e650387900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.601954:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226471936 00000100:00100000:3.0:1788863571.601978:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226471936 00000100:00100000:3.0:1788863571.602228:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863571.602239:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10005:x1875759226471936:12345-0@lo:5: 00002000:00080000:2.0:1788863571.609287:0:8606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788863571.609307:0:8606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788863571.612042:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10005:x1875759226471936:12345-0@lo:5: Request processed in 9798us (14271us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788863571.612055:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788863571.612227:0:10005:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681e2f480 x1875759226471936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863571.612244:0:10005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10005:1875759226471936:0@lo:5: 00000004:00080000:1.0:1788863571.612260:0:10005:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:2.0:1788863572.070357:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1788863572.141784:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863572.459390:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863572.459419:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226472064:0@lo:41: 00000100:00100000:1.0:1788863572.459513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863572.459545:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863572.459558:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226472192:0@lo:41: 00000100:00100000:0.0:1788863572.459595:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863572.459708:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472064 00000100:00100000:1.0:1788863572.459717:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472064 00000100:00100000:1.0:1788863572.459766:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472192 00000100:00100000:1.0:1788863572.459770:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472192 00000100:00100000:1.0:1788863572.459792:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863572.459799:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226472064:12345-0@lo:41: 00000004:00000024:1.0:1788863572.459839:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863572.459895:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226472064:12345-0@lo:41: Request processed in 96us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863572.459905:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788863572.459966:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226472064:0@lo:41: 00000100:00100000:0.0:1788863572.459987:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226472192:12345-0@lo:41: 00000004:00000024:0.0:1788863572.460008:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788863572.460129:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226472192:12345-0@lo:41: Request processed in 146us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863572.460202:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226472192:0@lo:41: 00000100:00100000:1.0:1788863572.463698:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788863572.465777:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000020:00000004:1.0:1788863572.986626:0:10056:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863572.986987:0:10056:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788863573.165752:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788863573.864798:0:10104:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788863573.864808:0:10104:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788863574.187317:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863574.471780:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863574.472003:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205449856 00000100:00100000:1.0:1788863574.472015:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205449856 00000100:00100000:1.0:1788863574.472159:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 179 00000100:00100000:1.0:1788863574.472168:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2407:x1875759205449856:12345-192.168.204.35@tcp:250: 00010000:00080000:1.0:1788863574.472204:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ed3e4520-177d-4764-9911-f67f7853934a@192.168.204.35@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1788863574.472234:0:6529:0:(genops.c:1384:class_connect()) connect: client ed3e4520-177d-4764-9911-f67f7853934a, cookie 0xf569beb9d4b68ceb 00000100:00080000:1.0:1788863574.472406:0:6529:0:(import.c:65:import_set_state_nolock()) ffff89e54343b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863574.472480:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+5:2407:x1875759205449856:12345-192.168.204.35@tcp:250: Request processed in 311us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863574.472487:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 179 00000100:00100000:2.0:1788863574.478404:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863574.478515:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205449984 00000100:00100000:0.0:1788863574.478528:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205449984 00000100:00100000:0.0:1788863574.478593:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 180 00000100:00100000:0.0:1788863574.478603:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+5:6174:x1875759205449984:12345-192.168.204.35@tcp:101: 00010000:00010000:0.0:1788863574.478624:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863574.478642:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187d3e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863574.478695:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863574.478708:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863574.478816:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d91c00, rc 0) 00000100:00100000:0.0:1788863574.479061:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+6:6174:x1875759205449984:12345-192.168.204.35@tcp:101: Request processed in 457us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863574.479070:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 180 00000100:00100000:2.0:1788863574.507250:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863574.507393:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205450112 00000100:00100000:1.0:1788863574.507404:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205450112 00000100:00100000:1.0:1788863574.507475:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 181 00000100:00100000:1.0:1788863574.507486:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+6:6174:x1875759205450112:12345-192.168.204.35@tcp:501: 00000100:00100000:1.0:1788863574.507622:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+6:6174:x1875759205450112:12345-192.168.204.35@tcp:501: Request processed in 138us (382us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788863574.507645:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 181 00000100:00100000:2.0:1788863574.510206:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863574.510314:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205450240 00000100:00100000:0.0:1788863574.510324:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205450240 00000100:00100000:0.0:1788863574.510384:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 182 00000100:00100000:0.0:1788863574.510393:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+6:6174:x1875759205450240:12345-192.168.204.35@tcp:101: 00010000:00010000:0.0:1788863574.510408:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863574.510428:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187d45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863574.510461:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863574.510472:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863574.510482:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90400, rc 0) 00000100:00100000:0.0:1788863574.510552:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+7:6174:x1875759205450240:12345-192.168.204.35@tcp:101: Request processed in 159us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863574.510580:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 182 00000100:00100000:2.0:1788863574.513258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863574.513429:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205450368 00000100:00100000:1.0:1788863574.513442:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205450368 00000100:00100000:1.0:1788863574.513567:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 183 00000100:00100000:1.0:1788863574.513576:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+7:6174:x1875759205450368:12345-192.168.204.35@tcp:501: 00000100:00100000:1.0:1788863574.513763:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+8:6174:x1875759205450368:12345-192.168.204.35@tcp:501: Request processed in 187us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863574.513772:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 183 00000100:00100000:3.0:1788863574.516706:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863574.516809:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205450496 00000100:00100000:2.0:1788863574.516820:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205450496 00000100:00100000:2.0:1788863574.516898:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 184 00000100:00100000:2.0:1788863574.517567:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+8:6174:x1875759205450496:12345-192.168.204.35@tcp:503: 00000100:00100000:2.0:1788863574.517755:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+8:6174:x1875759205450496:12345-192.168.204.35@tcp:503: Request processed in 199us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863574.517763:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 184 00000100:00100000:0.0:1788863574.531337:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863574.531483:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205450624 00000100:00100000:3.0:1788863574.531494:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205450624 00000100:00100000:3.0:1788863574.531591:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00100000:3.0:1788863574.531602:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+8:6192:x1875759205450624:12345-192.168.204.35@tcp:502: 00000100:00100000:3.0:1788863574.531873:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+8:6192:x1875759205450624:12345-192.168.204.35@tcp:502: Request processed in 271us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863574.531882:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00100000:3.0:1788863574.571391:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863574.572231:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205450752 00000100:00100000:1.0:1788863574.572243:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205450752 00000100:00100000:1.0:1788863574.572319:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:1.0:1788863574.572329:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+8:6192:x1875759205450752:12345-192.168.204.35@tcp:502: 00000100:00100000:1.0:1788863574.572513:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+8:6192:x1875759205450752:12345-192.168.204.35@tcp:502: Request processed in 184us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863574.572521:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:2.0:1788863574.579422:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863574.579838:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205450880 00000100:00100000:3.0:1788863574.579849:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205450880 00000100:00100000:3.0:1788863574.579919:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 187 00000100:00100000:3.0:1788863574.579930:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+8:6174:x1875759205450880:12345-192.168.204.35@tcp:101: 00010000:00010000:3.0:1788863574.579948:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863574.579967:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187d76 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863574.580037:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d76 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863574.580050:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d76 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863574.580059:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d200, rc 0) 00000100:00100000:3.0:1788863574.580207:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+9:6174:x1875759205450880:12345-192.168.204.35@tcp:101: Request processed in 277us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863574.580215:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 187 00000100:00100000:3.0:1788863574.585179:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863574.585280:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451008 00000100:00100000:0.0:1788863574.585291:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451008 00000100:00100000:0.0:1788863574.585350:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 188 00000100:00100000:0.0:1788863574.585362:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:6174:x1875759205451008:12345-192.168.204.35@tcp:256: 20000000:01000000:0.0:1788863574.585387:0:6532:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788863574.585411:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788863574.585415:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788863574.585418:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788863574.585420:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788863574.585423:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788863574.593819:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:6174:x1875759205451008:12345-192.168.204.35@tcp:256: Request processed in 8446us (8636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863574.593835:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 188 00000100:00100000:2.0:1788863574.607858:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863574.609333:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451136 00000100:00100000:1.0:1788863574.609346:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451136 00000100:00100000:1.0:1788863574.609421:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 189 00000100:00100000:1.0:1788863574.609432:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+9:6174:x1875759205451136:12345-192.168.204.35@tcp:101: 00010000:00010000:1.0:1788863574.609452:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863574.609477:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187d7d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863574.609510:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863574.609558:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863574.609568:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650115400, rc 0) 00000100:00100000:1.0:1788863574.609659:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:6174:x1875759205451136:12345-192.168.204.35@tcp:101: Request processed in 228us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863574.609666:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 189 00000100:00100000:3.0:1788863574.617625:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863574.617798:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451264 00000100:00100000:0.0:1788863574.617810:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451264 00000100:00100000:0.0:1788863574.617878:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 190 00000100:00100000:0.0:1788863574.617890:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6174:x1875759205451264:12345-192.168.204.35@tcp:501: 00000100:00100000:0.0:1788863574.618128:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6174:x1875759205451264:12345-192.168.204.35@tcp:501: Request processed in 240us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863574.618137:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 190 00000100:00100000:2.0:1788863574.621274:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863574.621481:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451392 00000100:00100000:3.0:1788863574.621492:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451392 00000100:00100000:3.0:1788863574.621562:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 191 00000100:00100000:3.0:1788863574.621572:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:6174:x1875759205451392:12345-192.168.204.35@tcp:503: 00000100:00100000:3.0:1788863574.621738:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:6174:x1875759205451392:12345-192.168.204.35@tcp:503: Request processed in 166us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863574.621745:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 191 00000100:00100000:2.0:1788863574.628485:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863574.629207:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451520 00000100:00100000:1.0:1788863574.629220:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451520 00000100:00100000:1.0:1788863574.629281:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 192 00000100:00100000:1.0:1788863574.629291:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:6195:x1875759205451520:12345-192.168.204.35@tcp:502: 00000100:00100000:1.0:1788863574.629490:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:6195:x1875759205451520:12345-192.168.204.35@tcp:502: Request processed in 199us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863574.629499:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 192 00000100:00100000:1.0:1788863574.635977:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863574.648619:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451648 00000100:00100000:0.0:1788863574.648637:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451648 00000100:00100000:0.0:1788863574.648702:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00100000:0.0:1788863574.648712:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6195:x1875759205451648:12345-192.168.204.35@tcp:502: 00000100:00100000:0.0:1788863574.648888:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6195:x1875759205451648:12345-192.168.204.35@tcp:502: Request processed in 177us (12924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863574.648896:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00100000:2.0:1788863574.665783:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863574.665827:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863574.666065:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451776 00000100:00100000:3.0:1788863574.666268:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451776 00000100:00100000:0.0:1788863574.666538:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452032 00000100:00100000:0.0:1788863574.666550:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452032 00000100:00100000:0.0:1788863574.666767:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:0.0:1788863574.666776:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875759205452032:12345-192.168.204.35@tcp:38: 00010000:00080000:0.0:1788863574.666815:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:0.0:1788863574.666873:0:6537:0:(genops.c:1384:class_connect()) connect: client 7a6822fa-e36f-4316-b7e3-4bba6134cbda, cookie 0xf569beb9d4b68d0e 00000004:00100000:0.0:1788863574.666902:0:6537:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788863574.667796:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e5439c0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863574.667963:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2407:x1875759205452032:12345-192.168.204.35@tcp:38: Request processed in 1183us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863574.667972:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:2.0:1788863574.668919:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:2.0:1788863574.668932:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1875759205451776:12345-192.168.204.35@tcp:38: 00010000:00080000:2.0:1788863574.668975:0:6536:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1788863574.669048:0:6536:0:(genops.c:1384:class_connect()) connect: client 7a6822fa-e36f-4316-b7e3-4bba6134cbda, cookie 0xf569beb9d4b68d15 00000004:00100000:2.0:1788863574.669097:0:6536:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788863574.669389:0:6536:0:(import.c:65:import_set_state_nolock()) ffff89e67aeec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863574.669458:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2407:x1875759205451776:12345-192.168.204.35@tcp:38: Request processed in 527us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863574.669466:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00010000:00010000:1.0:1788863575.215905:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863575.463817:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863575.463877:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863575.463915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863575.464054:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452160 00000100:00100000:1.0:1788863575.464073:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452160 00000100:00100000:1.0:1788863575.464220:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452288 00000100:00100000:1.0:1788863575.464224:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452288 00000100:00100000:1.0:1788863575.464242:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205451904 00000100:00100000:1.0:1788863575.464245:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205451904 00000100:00100000:1.0:1788863575.464264:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:1.0:1788863575.464275:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:0:x1875759205452160:12345-192.168.204.35@tcp:41: 00000004:00000024:1.0:1788863575.464337:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863575.464427:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:0:x1875759205452160:12345-192.168.204.35@tcp:41: Request processed in 154us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863575.464455:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:1.0:1788863575.464477:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1788863575.464483:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:6174:x1875759205452288:12345-192.168.204.35@tcp:41: 00000004:00000024:1.0:1788863575.464503:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788863575.464530:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:6174:x1875759205452288:12345-192.168.204.35@tcp:41: Request processed in 47us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863575.464536:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1788863575.464547:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:1.0:1788863575.464554:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:0:x1875759205451904:12345-192.168.204.35@tcp:41: 00000004:00000024:1.0:1788863575.464564:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788863575.464599:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:0:x1875759205451904:12345-192.168.204.35@tcp:41: Request processed in 46us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863575.464605:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00080000:2.0:1788863575.469929:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863575.469946:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863575.474838:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863575.475009:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452416 00000100:00100000:2.0:1788863575.475043:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452416 00000100:00100000:0.0:1788863575.475587:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:0.0:1788863575.475603:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6174:x1875759205452416:12345-192.168.204.35@tcp:40: 00000100:00100000:0.0:1788863575.475753:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6174:x1875759205452416:12345-192.168.204.35@tcp:40: Request processed in 154us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863575.475760:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1788863575.482134:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863575.482196:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863575.482388:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452800 00000100:00100000:2.0:1788863575.482401:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452800 00000100:00100000:2.0:1788863575.482472:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 194 00000100:00100000:2.0:1788863575.482485:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2411:x1875759205452800:12345-192.168.204.35@tcp:400: 00000100:00100000:2.0:1788863575.482596:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2411:x1875759205452800:12345-192.168.204.35@tcp:400: Request processed in 113us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863575.482605:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 194 00000100:00100000:3.0:1788863575.482948:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452544 00000100:00100000:3.0:1788863575.482955:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452544 00000100:00100000:3.0:1788863575.482997:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:3.0:1788863575.483003:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1875759205452544:12345-192.168.204.35@tcp:8: 00010000:00080000:3.0:1788863575.483040:0:8452:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1788863575.483140:0:8452:0:(genops.c:1384:class_connect()) connect: client 7a6822fa-e36f-4316-b7e3-4bba6134cbda, cookie 0xf569beb9d4b68d1c 00002000:00100000:3.0:1788863575.483169:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a6822fa-e36f-4316-b7e3-4bba6134cbda/ffff89e543a41000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788863575.483199:0:8452:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788863575.483657:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788863575.483701:0:8452:0:(import.c:65:import_set_state_nolock()) ffff89e543a40800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863575.483757:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2407:x1875759205452544:12345-192.168.204.35@tcp:8: Request processed in 752us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863575.483765:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:2.0:1788863575.486355:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863575.487392:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452672 00000100:00100000:1.0:1788863575.487410:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452672 00000100:00100000:1.0:1788863575.487479:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1788863575.487489:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2407:x1875759205452672:12345-192.168.204.35@tcp:8: 00010000:00080000:1.0:1788863575.487550:0:8451:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1788863575.487594:0:8451:0:(genops.c:1384:class_connect()) connect: client 7a6822fa-e36f-4316-b7e3-4bba6134cbda, cookie 0xf569beb9d4b68d23 00002000:00100000:1.0:1788863575.487609:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a6822fa-e36f-4316-b7e3-4bba6134cbda/ffff89e67ad5b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788863575.487631:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788863575.487913:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788863575.487959:0:8451:0:(import.c:65:import_set_state_nolock()) ffff89e681a7a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863575.489330:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2407:x1875759205452672:12345-192.168.204.35@tcp:8: Request processed in 1830us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863575.489346:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788863575.490791:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863575.491030:0:6548:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205452928 00000100:00100000:0.0:1788863575.491054:0:6548:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205452928 00000100:00100000:0.0:1788863575.491173:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:0.0:1788863575.491185:0:6548:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6174:x1875759205452928:12345-192.168.204.35@tcp:900: 00000100:00100000:0.0:1788863575.491605:0:6548:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6174:x1875759205452928:12345-192.168.204.35@tcp:900: Request processed in 420us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863575.491639:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:2.0:1788863575.501889:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863575.502250:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453056 00000100:00100000:3.0:1788863575.502264:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453056 00000100:00100000:3.0:1788863575.502643:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:3.0:1788863575.502657:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6174:x1875759205453056:12345-192.168.204.35@tcp:33: 00000004:00080000:0.0:1788863575.554917:0:6539:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 52148us 00000004:00200000:0.0:1788863575.582925:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788863575.583060:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6174:x1875759205453056:12345-192.168.204.35@tcp:33: Request processed in 80398us (81177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863575.583113:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:1.0:1788863575.877277:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863575.877370:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453184 00000100:00100000:3.0:1788863575.877381:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453184 00000100:00100000:3.0:1788863575.877494:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:3.0:1788863575.877504:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6213:x1875759205453184:12345-192.168.204.35@tcp:101: 00010000:00010000:3.0:1788863575.877525:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863575.877602:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c800/0xf569beb9d4b68d2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187dae expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863575.877681:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b68d31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863575.877696:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b68d31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863575.877730:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b68d31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863575.877975:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788863575.877980:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863575.877997:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b68d31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863575.878025:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c800/0xf569beb9d4b68d2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dae expref: 8 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863575.878045:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b68d31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dae expref: 7 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863575.878054:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e650ec3600) 00010000:00010000:3.0:1788863575.878057:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863575.878061:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167c200, rc 0) 00000100:00100000:3.0:1788863575.878199:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:6213:x1875759205453184:12345-192.168.204.35@tcp:101: Request processed in 696us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863575.878207:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:3.0:1788863576.044863:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863576.044915:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226472320:0@lo:13: 00000100:00100000:3.0:1788863576.045142:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.045346:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472320 00000100:00100000:1.0:1788863576.045355:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472320 00000100:00100000:1.0:1788863576.045430:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788863576.045447:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226472320:12345-0@lo:13: 00002000:00000024:1.0:1788863576.045491:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863576.045560:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226472320:12345-0@lo:13: Request processed in 118us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863576.045567:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863576.046194:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226472448:0@lo:13: 00000100:00100000:2.0:1788863576.046255:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.046373:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472448 00000100:00100000:1.0:1788863576.046379:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472448 00000100:00100000:1.0:1788863576.046408:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788863576.046418:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226472448:12345-0@lo:13: 00002000:00000024:1.0:1788863576.046438:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863576.046494:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226472448:12345-0@lo:13: Request processed in 77us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863576.046504:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788863576.046682:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863576.046721:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af58000 x1875759226472320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863576.046757:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226472320:0@lo:13: 00010000:00080000:2.0:1788863576.047350:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af59180 x1875759226472448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863576.047368:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226472448:0@lo:13: 00010000:00010000:1.0:1788863576.235384:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863576.555572:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226472832:0@lo:400: 00000100:00100000:1.0:1788863576.555643:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.555709:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226473344:0@lo:400: 00000100:00100000:1.0:1788863576.555735:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.555775:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226473856:0@lo:400: 00000100:00100000:1.0:1788863576.555801:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.555833:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788863576.555839:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226472704:0@lo:400: 00000100:00100000:1.0:1788863576.555874:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.555896:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226473216:0@lo:400: 00000100:00100000:1.0:1788863576.555940:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.555961:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226473728:0@lo:400: 00000100:00100000:1.0:1788863576.555981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.556017:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472832 00000100:00100000:1.0:1788863576.556026:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472832 00000100:00100000:1.0:1788863576.556070:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863576.556218:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473856 00000100:00100000:3.0:1788863576.556223:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473856 00000100:00100000:3.0:1788863576.556257:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473728 00000100:00100000:3.0:1788863576.556259:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473728 00000100:00100000:3.0:1788863576.556280:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863576.556288:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226473856:12345-0@lo:400: 00000100:00100000:3.0:1788863576.556346:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226473856:12345-0@lo:400: Request processed in 59us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863576.556353:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863576.556369:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863576.556374:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226473728:12345-0@lo:400: 00000100:00100000:3.0:1788863576.556399:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226473728:12345-0@lo:400: Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863576.556404:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863576.556494:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473344 00000100:00100000:0.0:1788863576.556499:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473344 00000100:00100000:0.0:1788863576.556522:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472704 00000100:00100000:0.0:1788863576.556524:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472704 00000100:00100000:0.0:1788863576.556534:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473216 00000100:00100000:0.0:1788863576.556536:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473216 00000100:00100000:0.0:1788863576.556548:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863576.556553:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226473344:12345-0@lo:400: 00000100:00100000:0.0:1788863576.556583:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226473344:12345-0@lo:400: Request processed in 31us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863576.556588:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863576.556598:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788863576.556603:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226472704:12345-0@lo:400: 00000100:00100000:0.0:1788863576.556626:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226472704:12345-0@lo:400: Request processed in 23us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863576.556631:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788863576.556641:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863576.556647:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226473216:12345-0@lo:400: 00000100:00100000:0.0:1788863576.556671:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226473216:12345-0@lo:400: Request processed in 25us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863576.556687:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863576.556740:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226472704:0@lo:400: 00000100:00100000:0.0:1788863576.556752:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226473216:0@lo:400: 00010000:00080000:0.0:1788863576.556766:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af5aa00 x1875759226473728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863576.556774:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788863576.556787:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226473728:0@lo:400: 00010000:00080000:0.0:1788863576.556797:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af59c00 x1875759226473344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863576.556806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226473344:0@lo:400: 00010000:00080000:0.0:1788863576.556814:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af5b800 x1875759226473856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863576.556821:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788863576.556829:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226473856:0@lo:400: 00000100:00100000:0.0:1788863576.556866:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226472960:0@lo:400: 00000100:00100000:0.0:1788863576.556893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863576.556913:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226473472:0@lo:400: 00000100:00100000:0.0:1788863576.556931:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863576.556952:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788863576.556957:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226472576:0@lo:400: 00000100:00100000:0.0:1788863576.556982:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863576.557004:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226473088:0@lo:400: 00000100:00100000:0.0:1788863576.557033:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863576.557048:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226473600:0@lo:400: 00000100:00100000:0.0:1788863576.557064:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.557217:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226472832:12345-0@lo:400: 00000100:00100000:1.0:1788863576.557254:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226472832:12345-0@lo:400: Request processed in 42us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863576.557276:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473088 00000100:00100000:0.0:1788863576.557280:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473088 00000100:00100000:2.0:1788863576.557346:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472960 00000100:00100000:2.0:1788863576.557350:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472960 00000100:00100000:2.0:1788863576.557368:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473472 00000100:00100000:2.0:1788863576.557370:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473472 00000100:00100000:2.0:1788863576.557380:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473600 00000100:00100000:2.0:1788863576.557382:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473600 00000100:00100000:2.0:1788863576.557393:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788863576.557398:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226472960:12345-0@lo:400: 00000100:00100000:2.0:1788863576.557433:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226472960:12345-0@lo:400: Request processed in 34us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863576.557438:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788863576.557449:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863576.557454:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226473472:12345-0@lo:400: 00000100:00100000:2.0:1788863576.557483:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226473472:12345-0@lo:400: Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863576.557489:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863576.557500:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788863576.557505:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226473600:12345-0@lo:400: 00000100:00100000:2.0:1788863576.557523:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226473600:12345-0@lo:400: Request processed in 18us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863576.557528:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788863576.557548:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af59880 x1875759226473600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863576.557558:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226473600:0@lo:400: 00000100:00100000:2.0:1788863576.557567:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226472960:0@lo:400: 00000100:00100000:2.0:1788863576.557574:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226473472:0@lo:400: 00000100:00080000:2.0:1788863576.557600:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863576.557603:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863576.557606:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863576.557636:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226472576 00000100:00100000:2.0:1788863576.557639:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226472576 00000100:00100000:2.0:1788863576.557659:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788863576.557664:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226472576:12345-0@lo:400: 00000100:00100000:2.0:1788863576.557693:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226472576:12345-0@lo:400: Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863576.557699:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788863576.557724:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226472576:0@lo:400: 00000100:00100000:2.0:1788863576.557750:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226472832:0@lo:400: 00000100:00100000:1.0:1788863576.567060:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788863576.567417:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788863576.567438:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226473088:12345-0@lo:400: 00000100:00100000:0.0:1788863576.567550:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226473088:12345-0@lo:400: Request processed in 123us (10515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863576.567557:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788863576.567634:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226473088:0@lo:400: 00000100:00100000:0.0:1788863577.067407:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863577.067439:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226473984:0@lo:13: 00000100:00100000:0.0:1788863577.067522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863577.068090:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226473984 00000100:00100000:1.0:1788863577.068099:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226473984 00000100:00100000:1.0:1788863577.068158:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788863577.068168:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226473984:12345-0@lo:13: 00002000:00000024:1.0:1788863577.068200:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863577.068263:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226473984:12345-0@lo:13: Request processed in 97us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863577.068270:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788863577.068401:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01880 x1875759226473984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863577.068419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226473984:0@lo:13: 00000100:00100000:0.0:1788863577.070006:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863577.070030:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226474112:0@lo:13: 00000100:00100000:0.0:1788863577.070135:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863577.070328:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226474112 00000100:00100000:1.0:1788863577.070335:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226474112 00000100:00100000:1.0:1788863577.070385:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788863577.070411:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226474112:12345-0@lo:13: 00002000:00000024:1.0:1788863577.070433:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863577.070492:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226474112:12345-0@lo:13: Request processed in 81us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863577.070498:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788863577.071469:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5428a8e00 x1875759226474112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863577.071492:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226474112:0@lo:13: 00010000:00010000:0.0:1788863577.259427:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863577.582818:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863577.582843:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226474240:0@lo:41: 00000100:00100000:2.0:1788863577.582909:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863577.583070:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226474240 00000100:00100000:1.0:1788863577.583102:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226474240 00000100:00100000:1.0:1788863577.583151:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788863577.583159:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226474240:12345-0@lo:41: 00000004:00000024:1.0:1788863577.583194:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788863577.583239:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226474240:12345-0@lo:41: Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863577.583245:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788863577.583284:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226474240:0@lo:41: 00000100:00100000:1.0:1788863577.586685:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226474368:0@lo:41: 00000100:00100000:1.0:1788863577.586774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863577.586980:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226474368 00000100:00100000:2.0:1788863577.586988:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226474368 00000100:00100000:2.0:1788863577.587042:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788863577.587061:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226474368:12345-0@lo:41: 00000004:00000024:2.0:1788863577.587143:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863577.587208:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226474368:12345-0@lo:41: Request processed in 158us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863577.587215:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863577.587304:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226474368:0@lo:41: 00010000:00010000:1.0:1788863578.284238:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863578.473012:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863578.474598:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453312 00000100:00100000:2.0:1788863578.474624:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453312 00000100:00080000:3.0:1788863578.474913:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863578.475107:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1788863578.475119:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:6265:x1875759205453312:12345-192.168.204.35@tcp:41: 00000004:00000024:2.0:1788863578.475162:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788863578.475249:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:6265:x1875759205453312:12345-192.168.204.35@tcp:41: Request processed in 133us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863578.475256:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1788863578.483581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863578.491246:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453440 00000100:00100000:3.0:1788863578.491271:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453440 00000100:00100000:3.0:1788863578.491568:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:3.0:1788863578.491580:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6265:x1875759205453440:12345-192.168.204.35@tcp:41: 00000004:00000024:3.0:1788863578.491621:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788863578.491705:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6265:x1875759205453440:12345-192.168.204.35@tcp:41: Request processed in 127us (8134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863578.491728:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00080000:2.0:1788863578.492941:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863578.499711:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863578.499927:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453568 00000100:00100000:2.0:1788863578.499951:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453568 00000100:00100000:2.0:1788863578.500116:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788863578.500128:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6265:x1875759205453568:12345-192.168.204.35@tcp:13: 00002000:00000024:2.0:1788863578.500172:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863578.500242:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6265:x1875759205453568:12345-192.168.204.35@tcp:13: Request processed in 116us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863578.500249:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00080000:3.0:1788863578.500718:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863578.503734:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863578.504264:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453696 00000100:00100000:2.0:1788863578.504285:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453696 00000100:00080000:3.0:1788863578.504441:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863578.504913:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1788863578.504926:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6265:x1875759205453696:12345-192.168.204.35@tcp:13: 00002000:00000024:2.0:1788863578.504954:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863578.505029:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:6265:x1875759205453696:12345-192.168.204.35@tcp:13: Request processed in 107us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863578.505048:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00010000:00010000:0.0:1788863579.307348:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788863579.630799:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00010000:00010000:0.0:1788863580.331346:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863580.655211:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863580.655256:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863580.655290:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863580.655312:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863580.655339:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863580.655366:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453952 00000100:00100000:1.0:1788863580.655375:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453952 00000100:00100000:1.0:1788863580.655462:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454080 00000100:00100000:1.0:1788863580.655472:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454080 00000100:00100000:1.0:1788863580.655498:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:1.0:1788863580.655507:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205453952:12345-192.168.204.35@tcp:400: 00000100:00100000:1.0:1788863580.655585:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205453952:12345-192.168.204.35@tcp:400: Request processed in 78us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863580.655593:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:1.0:1788863580.655611:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:1.0:1788863580.655618:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205454080:12345-192.168.204.35@tcp:400: 00000100:00100000:1.0:1788863580.655642:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205454080:12345-192.168.204.35@tcp:400: Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863580.655647:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:1.0:1788863580.655668:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454208 00000100:00100000:1.0:1788863580.655672:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454208 00000100:00100000:1.0:1788863580.655698:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454336 00000100:00100000:1.0:1788863580.655701:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454336 00000100:00100000:1.0:1788863580.655721:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1788863580.655728:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205454208:12345-192.168.204.35@tcp:400: 00000100:00100000:1.0:1788863580.655753:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205454208:12345-192.168.204.35@tcp:400: Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863580.656275:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205453824 00000100:00100000:0.0:1788863580.656282:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205453824 00000100:00100000:0.0:1788863580.656322:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 196 00000100:00100000:0.0:1788863580.656330:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205453824:12345-192.168.204.35@tcp:400: 00000100:00100000:0.0:1788863580.656360:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205453824:12345-192.168.204.35@tcp:400: Request processed in 32us (1104us total) trans 0 rc 0/0 00000100:00080000:2.0:1788863580.656361:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863580.656366:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863580.656368:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863580.656370:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863580.656377:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 196 00000100:00100000:1.0:1788863580.659773:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1788863580.659953:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:2.0:1788863580.660121:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454336:12345-192.168.204.35@tcp:400: 00000100:00100000:2.0:1788863580.660206:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454336:12345-192.168.204.35@tcp:400: Request processed in 242us (4866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863580.660214:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000001:00100000:2.0:1788863580.660775:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000001:00100000:3.0:1788863580.663181:0:7467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000001:00100000:2.0:1788863580.663281:0:6516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000100:00100000:2.0:1788863581.163358:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226474496:0@lo:13: 00000100:00100000:2.0:1788863581.163450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863581.163554:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226474496 00000100:00100000:2.0:1788863581.163563:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226474496 00000100:00100000:2.0:1788863581.163619:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788863581.163629:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226474496:12345-0@lo:13: 00002000:00000024:2.0:1788863581.163659:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863581.163706:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226474496:12345-0@lo:13: Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.163713:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788863581.163733:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788863581.163762:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5428abb80 x1875759226474496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863581.163794:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226474496:0@lo:13: 00000100:00100000:0.0:1788863581.165332:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863581.165362:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226474624:0@lo:13: 00000100:00100000:0.0:1788863581.165416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863581.165474:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226474624 00000100:00100000:0.0:1788863581.165481:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226474624 00000100:00100000:0.0:1788863581.165533:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863581.165544:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226474624:12345-0@lo:13: 00002000:00000024:0.0:1788863581.165594:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863581.165638:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226474624:12345-0@lo:13: Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863581.165645:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788863581.165670:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863581.165699:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438de680 x1875759226474624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863581.165719:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226474624:0@lo:13: 00010000:00010000:1.0:1788863581.355595:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788863581.373053:0:10202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788863581.675735:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226474880:0@lo:400: 00000100:00100000:1.0:1788863581.675838:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863581.675916:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226475392:0@lo:400: 00000100:00100000:1.0:1788863581.675943:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863581.676003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226475904:0@lo:400: 00000100:00100000:1.0:1788863581.676038:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863581.676097:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788863581.676105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226474752:0@lo:400: 00000100:00100000:1.0:1788863581.676138:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863581.679490:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226474880 00000100:00100000:0.0:1788863581.679512:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226474880 00000100:00100000:0.0:1788863581.679626:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475392 00000100:00100000:0.0:1788863581.679630:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475392 00000100:00100000:1.0:1788863581.679785:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226475264:0@lo:400: 00000100:00100000:1.0:1788863581.679866:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863581.679893:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226475776:0@lo:400: 00000100:00100000:2.0:1788863581.679907:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226474752 00000100:00100000:2.0:1788863581.679914:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226474752 00000100:00100000:1.0:1788863581.679930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863581.679959:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788863581.679990:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226474752:12345-0@lo:400: 00000100:00100000:2.0:1788863581.680061:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226474752:12345-0@lo:400: Request processed in 92us (3921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.680069:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1788863581.680166:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863581.680184:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226475008:0@lo:400: 00000100:00100000:2.0:1788863581.680217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863581.680237:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226475520:0@lo:400: 00000100:00100000:2.0:1788863581.680267:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226475136:0@lo:400: 00000100:00100000:2.0:1788863581.680315:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475264 00000100:00100000:2.0:1788863581.680319:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475264 00000100:00100000:2.0:1788863581.680347:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475008 00000100:00100000:2.0:1788863581.680351:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475008 00000100:00100000:2.0:1788863581.680366:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788863581.680372:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226475264:12345-0@lo:400: 00000100:00100000:2.0:1788863581.680410:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226475264:12345-0@lo:400: Request processed in 38us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.680417:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788863581.680433:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788863581.680438:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226475008:12345-0@lo:400: 00000100:00100000:2.0:1788863581.680469:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226475008:12345-0@lo:400: Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.680474:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788863581.680508:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475904 00000100:00100000:2.0:1788863581.680512:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475904 00000100:00100000:2.0:1788863581.680546:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863581.680553:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226475904:12345-0@lo:400: 00000100:00100000:2.0:1788863581.680587:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226475904:12345-0@lo:400: Request processed in 34us (4549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.680593:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788863581.685592:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475776 00000100:00100000:3.0:1788863581.685616:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475776 00010000:00080000:1.0:1788863581.685640:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438c3b80 x1875759226475904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863581.685664:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226475904:0@lo:400: 00000100:00100000:1.0:1788863581.685699:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226474752:0@lo:400: 00000100:00100000:1.0:1788863581.685713:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226475264:0@lo:400: 00000100:00100000:0.0:1788863581.685740:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863581.685762:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226474880:12345-0@lo:400: 00000100:00100000:1.0:1788863581.685770:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863581.685800:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226476032:0@lo:400: 00000100:00100000:1.0:1788863581.685866:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863581.685912:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226475008:0@lo:400: 00000100:00100000:1.0:1788863581.685933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863581.685951:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226475648:0@lo:400: 00000100:00100000:1.0:1788863581.685990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863581.686128:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226476032 00000100:00100000:3.0:1788863581.686134:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226476032 00000100:00100000:3.0:1788863581.686192:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863581.686200:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226476032:12345-0@lo:400: 00000100:00100000:3.0:1788863581.686248:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226476032:12345-0@lo:400: Request processed in 48us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863581.686255:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863581.686382:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226474880:12345-0@lo:400: Request processed in 630us (10544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863581.686389:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863581.686404:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475520 00000100:00100000:0.0:1788863581.686424:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475520 00000100:00100000:0.0:1788863581.686440:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475136 00000100:00100000:0.0:1788863581.686442:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475136 00000100:00100000:0.0:1788863581.686471:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226475648 00000100:00100000:0.0:1788863581.686473:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226475648 00000100:00100000:0.0:1788863581.686489:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863581.686495:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226475392:12345-0@lo:400: 00000100:00100000:0.0:1788863581.686529:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226475392:12345-0@lo:400: Request processed in 35us (10586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863581.686535:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863581.686548:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788863581.686554:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226475520:12345-0@lo:400: 00000100:00100000:0.0:1788863581.686580:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226475520:12345-0@lo:400: Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863581.686585:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788863581.686595:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788863581.686600:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226475136:12345-0@lo:400: 00000100:00100000:0.0:1788863581.686625:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226475136:12345-0@lo:400: Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863581.686688:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788863581.686700:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788863581.686706:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226475648:12345-0@lo:400: 00000100:00100000:0.0:1788863581.686730:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226475648:12345-0@lo:400: Request processed in 25us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863581.686735:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788863581.687600:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d03b80 x1875759226475520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863581.687618:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226475520:0@lo:400: 00010000:00080000:1.0:1788863581.687645:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438c0e00 x1875759226476032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863581.687654:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226476032:0@lo:400: 00000100:00100000:1.0:1788863581.687699:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226475136:0@lo:400: 00000100:00100000:1.0:1788863581.687715:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226475648:0@lo:400: 00000100:00080000:2.0:1788863581.688121:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863581.688129:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863581.688133:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863581.688203:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788863581.688213:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226475776:12345-0@lo:400: 00000100:00100000:2.0:1788863581.688300:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226475776:12345-0@lo:400: Request processed in 89us (8369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.688314:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788863581.688522:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863581.688567:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226474880:0@lo:400: 00000100:00100000:3.0:1788863581.688583:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226475392:0@lo:400: 00010000:00080000:3.0:1788863581.688607:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438c0700 x1875759226475776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863581.688618:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226475776:0@lo:400: 00000100:00100000:1.0:1788863582.187520:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226476160:0@lo:13: 00000100:00100000:1.0:1788863582.187637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863582.189863:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226476160 00000100:00100000:3.0:1788863582.189886:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226476160 00000100:00100000:3.0:1788863582.189996:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863582.190009:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226476160:12345-0@lo:13: 00002000:00000024:3.0:1788863582.190056:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863582.190199:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226476160:12345-0@lo:13: Request processed in 192us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863582.190233:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788863582.190300:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5428a8e00 x1875759226476160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863582.190327:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226476160:0@lo:13: 00000100:00100000:1.0:1788863582.193706:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863582.198817:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226476288:0@lo:13: 00000100:00100000:1.0:1788863582.199751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863582.199921:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226476288 00000100:00100000:3.0:1788863582.199934:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226476288 00000100:00100000:3.0:1788863582.200033:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863582.200047:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226476288:12345-0@lo:13: 00002000:00000024:3.0:1788863582.200114:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863582.200181:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226476288:12345-0@lo:13: Request processed in 137us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863582.200188:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788863582.200711:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5428a8e00 x1875759226476288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863582.200739:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226476288:0@lo:13: 00010000:00010000:1.0:1788863582.380906:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863582.699873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226476416:0@lo:41: 00000100:00100000:1.0:1788863582.700029:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863582.700194:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226476416 00000100:00100000:0.0:1788863582.700206:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226476416 00000100:00100000:0.0:1788863582.700301:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788863582.700311:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226476416:12345-0@lo:41: 00000004:00000024:0.0:1788863582.700386:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788863582.703819:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226476544:0@lo:41: 00000100:00100000:3.0:1788863582.703930:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863582.704207:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226476544 00000100:00100000:2.0:1788863582.704218:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226476544 00000100:00100000:2.0:1788863582.704271:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788863582.704281:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226476544:12345-0@lo:41: 00000004:00000024:2.0:1788863582.704337:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863582.704400:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226476544:12345-0@lo:41: Request processed in 119us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863582.704408:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788863582.704756:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226476544:0@lo:41: 00000100:00100000:0.0:1788863582.717533:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226476416:12345-0@lo:41: Request processed in 17207us (17488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863582.717552:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788863582.717764:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226476416:0@lo:41: 00010000:00010000:1.0:1788863583.404454:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863584.428755:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863585.454361:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788863585.755584:0:10349:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee6307c80 20000000:00000080:1.0:1788863585.755608:0:10349:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e67ade1c00 uarg=0000000000000000 20000000:01000000:1.0:1788863585.755668:0:10349:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788863585.755671:0:10349:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788863585.755675:0:10349:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788863585.755682:0:10349:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788863585.755690:0:10349:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788863585.755774:0:10349:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788863585.755778:0:10349:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788863585.757611:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788863585.758528:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788863585.758568:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788863585.758584:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788863585.758601:0:10349:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788863585.758604:0:10349:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788863585.760536:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788863585.761029:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788863585.761483:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788863585.761505:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788863585.761535:0:10349:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788863585.761538:0:10349:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788863585.763017:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788863585.763625:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788863585.763658:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788863585.763672:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788863585.763700:0:10349:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788863585.763703:0:10349:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788863585.766804:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788863585.767448:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788863585.767489:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788863585.767519:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788863585.767545:0:10349:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788863585.767548:0:10349:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788863585.768438:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788863585.768722:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788863585.768748:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788863585.768761:0:10349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1788863585.768784:0:10349:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788863585.768812:0:10349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768836:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768844:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768851:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768859:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768866:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768873:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768880:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768887:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768915:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768927:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768936:0:10349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.768943:0:10349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.769008:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.769030:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 9 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.769048:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226476672:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863585.769668:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.769683:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 9 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.769695:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226476800:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863585.769767:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.769793:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 23 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.769806:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226476928:0@lo:104: 00000100:00100000:2.0:1788863585.770334:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863585.770481:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226476928 00000100:00100000:0.0:1788863585.770492:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226476928 00000100:00100000:0.0:1788863585.770562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863585.770575:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226476928:12345-0@lo:104: 00010000:00010000:0.0:1788863585.770594:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.770663:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863585.770669:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226476928:12345-0@lo:104: Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863585.770677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788863585.770706:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863585.770713:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.770721:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863585.770725:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.770750:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863585.770757:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863585.770764:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863585.770807:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.770815:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863585.770840:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.770848:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b68cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ce4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.770863:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863585.770865:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863585.770867:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863585.770884:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226477056:0@lo:103: 00000100:00100000:0.0:1788863585.770937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863585.770993:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477056 00000100:00100000:0.0:1788863585.770998:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477056 00010000:00010000:0.0:1788863585.771017:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 24 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863585.771041:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863585.771049:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226477056:12345-0@lo:103: 00010000:00010000:0.0:1788863585.771069:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863585.771099:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 24 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.771110:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 24 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.771131:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863585.771543:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.771556:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 24 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.771569:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477184:0@lo:104: 00000100:00100000:2.0:1788863585.772737:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863585.772816:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.772831:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 24 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.772846:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477312:0@lo:104: 00000100:00100000:2.0:1788863585.772873:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863585.772912:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.772920:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 24 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.772929:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477440:0@lo:104: 00000100:00100000:2.0:1788863585.772969:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863585.772992:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.773001:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 24 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.773010:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477568:0@lo:104: 00010000:00010000:2.0:1788863585.773034:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.773041:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 24 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.773048:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477696:0@lo:104: 00010000:00010000:2.0:1788863585.773070:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.773103:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 24 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.773111:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477824:0@lo:104: 00010000:00010000:2.0:1788863585.773137:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.773294:0:7487:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788863585.773316:0:7487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.773330:0:7487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.773340:0:7487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.773350:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477184 00000100:00100000:1.0:1788863585.773370:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477184 00000100:00100000:1.0:1788863585.773418:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477312 00000100:00100000:1.0:1788863585.773421:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477312 00000100:00100000:1.0:1788863585.773432:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477440 00000100:00100000:1.0:1788863585.773434:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477440 00000100:00100000:1.0:1788863585.773444:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477568 00000100:00100000:1.0:1788863585.773446:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477568 00000100:00100000:1.0:1788863585.773459:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477696 00000100:00100000:1.0:1788863585.773461:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477696 00000100:00100000:1.0:1788863585.773474:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477824 00000100:00100000:1.0:1788863585.773476:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477824 00000100:00100000:1.0:1788863585.773490:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863585.773499:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+8:10349:x1875759226477184:12345-0@lo:104: 00010000:00010000:1.0:1788863585.773514:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.773642:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863585.773649:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+8:10349:x1875759226477184:12345-0@lo:104: Request processed in 151us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.773658:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863585.773685:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863585.773692:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+7:10349:x1875759226477312:12345-0@lo:104: 00010000:00010000:1.0:1788863585.773700:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.773750:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788863585.773757:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+7:10349:x1875759226477312:12345-0@lo:104: Request processed in 66us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.773763:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863585.773780:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863585.773786:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:10349:x1875759226477440:12345-0@lo:104: 00010000:00010000:1.0:1788863585.773795:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.773830:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788863585.773835:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:10349:x1875759226477440:12345-0@lo:104: Request processed in 50us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.773841:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863585.773890:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863585.773908:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:10349:x1875759226477568:12345-0@lo:104: 00010000:00010000:1.0:1788863585.773916:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.773942:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788863585.773947:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:10349:x1875759226477568:12345-0@lo:104: Request processed in 41us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.773952:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863585.773966:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863585.773971:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:10349:x1875759226477696:12345-0@lo:104: 00010000:00010000:1.0:1788863585.773978:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774011:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788863585.774016:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:10349:x1875759226477696:12345-0@lo:104: Request processed in 46us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.774021:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863585.774036:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863585.774041:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226477824:12345-0@lo:104: 00010000:00010000:1.0:1788863585.774048:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774069:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788863585.774110:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226477824:12345-0@lo:104: Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.774117:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788863585.774168:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788863585.774175:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774183:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650115a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.774188:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774197:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.774206:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.774212:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.774263:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774272:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.774296:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774304:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650115a00/0xf569beb9d4b68cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68cba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774319:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788863585.774322:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774327:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.774330:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774336:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.774343:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.774347:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.774359:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774367:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.774372:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774389:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114000/0xf569beb9d4b68c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774399:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788863585.774402:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774407:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.774410:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774418:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.774425:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.774429:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.774442:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774448:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.774464:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774472:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b68c6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774481:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788863585.774489:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774496:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167da00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.774499:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774505:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.774510:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.774516:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.774530:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774536:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.774540:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774546:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167da00/0xf569beb9d4b68c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c58 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774556:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863585.774559:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774565:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.774568:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774586:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.774592:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.774597:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.774613:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774618:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.774623:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774629:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c4a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774638:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863585.774640:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774645:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167cc00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.774648:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774654:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.774660:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.774670:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.774684:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774691:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.774695:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774701:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167cc00/0xf569beb9d4b68c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68c3c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.774710:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863585.774712:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863585.774714:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863585.774724:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863585.774754:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478080:0@lo:103: 00000100:00100000:1.0:1788863585.774800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.774845:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478592:0@lo:103: 00000100:00100000:1.0:1788863585.774864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.774880:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788863585.774885:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478208:0@lo:103: 00000100:00100000:1.0:1788863585.774917:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.774928:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478720:0@lo:103: 00000100:00100000:1.0:1788863585.774946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.774981:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.774990:0:6522:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788863585.775008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226478336:0@lo:103: 00000100:00100000:1.0:1788863585.775040:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.775053:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863585.775059:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226478464:0@lo:103: 00000100:00100000:1.0:1788863585.775108:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863585.775141:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863585.775521:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478080 00000100:00100000:1.0:1788863585.775530:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478080 00010000:00010000:1.0:1788863585.775562:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 25 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.775590:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.775596:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478592 00000100:00100000:1.0:1788863585.775599:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478592 00010000:00010000:1.0:1788863585.775610:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 26 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.775621:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.775626:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478208 00000100:00100000:1.0:1788863585.775628:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478208 00010000:00010000:1.0:1788863585.775638:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 27 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.775647:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.775650:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478720 00000100:00100000:1.0:1788863585.775653:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478720 00010000:00010000:1.0:1788863585.775661:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 28 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.775669:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.775673:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478336 00000100:00100000:1.0:1788863585.775676:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478336 00010000:00010000:1.0:1788863585.775684:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 29 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.775705:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.775712:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478464 00000100:00100000:1.0:1788863585.775715:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478464 00010000:00010000:1.0:1788863585.775726:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 30 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.775737:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.775744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863585.775817:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+30:3642:x1875759226478080:12345-0@lo:103: 00010000:00010000:1.0:1788863585.775833:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863585.775840:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 30 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.776064:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 24 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.776093:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477952:0@lo:104: 00000100:00100000:2.0:1788863585.776258:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.776927:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863585.777724:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454592 00000100:00100000:3.0:1788863585.777738:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454592 00000100:00100000:3.0:1788863585.777822:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788863585.777835:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205454592:12345-192.168.204.35@tcp:400: 00000100:00100000:0.0:1788863585.777996:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+30:3641:x1875759226477056:12345-0@lo:103: Request processed in 6944us (7054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863585.778008:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863585.778173:0:6524:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788863585.778187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863585.778197:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+29:3642:x1875759226478592:12345-0@lo:103: 00010000:00010000:0.0:1788863585.778213:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863585.778237:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 29 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.778307:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 29 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.778340:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863585.778412:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+29:3642:x1875759226478080:12345-0@lo:103: Request processed in 2596us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.778421:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863585.778443:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788863585.779366:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205454592:12345-192.168.204.35@tcp:400: Request processed in 1527us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.779382:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00080000:3.0:1788863585.779439:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863585.779509:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863585.779939:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863585.779953:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+28:3642:x1875759226478208:12345-0@lo:103: 00010000:00010000:1.0:1788863585.779973:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863585.779982:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 28 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.779997:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 28 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780025:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863585.780095:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+28:3642:x1875759226478208:12345-0@lo:103: Request processed in 148us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.780102:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863585.780127:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.780134:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863585.780140:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+27:3642:x1875759226478720:12345-0@lo:103: 00010000:00010000:1.0:1788863585.780160:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863585.780167:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 27 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780176:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 27 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780186:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863585.780209:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+27:3642:x1875759226478720:12345-0@lo:103: Request processed in 69us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.780215:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863585.780240:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.780247:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863585.780254:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+26:3640:x1875759226478336:12345-0@lo:103: 00010000:00010000:1.0:1788863585.780262:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863585.780267:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 26 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780275:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 26 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780296:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863585.780333:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+26:3640:x1875759226478336:12345-0@lo:103: Request processed in 80us (5292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.780340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863585.780353:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.780526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863585.780535:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3640:x1875759226478464:12345-0@lo:103: 00010000:00010000:1.0:1788863585.780544:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863585.780549:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 25 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780557:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 25 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780567:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863585.780593:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3640:x1875759226478464:12345-0@lo:103: Request processed in 59us (5484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.780599:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863585.780654:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226477952 00000100:00100000:1.0:1788863585.780663:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226477952 00000100:00100000:1.0:1788863585.780695:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863585.780700:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226477952:12345-0@lo:104: 00010000:00010000:1.0:1788863585.780715:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780759:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863585.780764:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226477952:12345-0@lo:104: Request processed in 64us (4507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.780780:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863585.780844:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478208:0@lo:103: 00000100:00100000:1.0:1788863585.780857:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478720:0@lo:103: 00000100:00100000:1.0:1788863585.780868:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478080:0@lo:103: 00000100:00100000:1.0:1788863585.780924:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226478464:0@lo:103: 00000100:00100000:1.0:1788863585.780933:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226478336:0@lo:103: 00010000:00010000:1.0:1788863585.780958:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863585.780966:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780974:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114e00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.780980:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.780989:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.780997:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.781003:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.781046:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.781053:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.781067:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.781108:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bfd expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.781126:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863585.781130:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863585.781131:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:1.0:1788863585.781133:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863585.781170:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863585.781197:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863585.781256:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454848 00000100:00100000:3.0:1788863585.781267:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454848 00000100:00100000:3.0:1788863585.781310:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454976 00000100:00100000:3.0:1788863585.781313:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454976 00000100:00100000:1.0:1788863585.781353:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226478848:0@lo:103: 00000100:00100000:1.0:1788863585.781401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863585.781455:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.781463:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478848 00000100:00100000:1.0:1788863585.781466:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478848 00010000:00010000:1.0:1788863585.781482:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 25 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.781495:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788863585.781503:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863585.781509:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3640:x1875759226478848:12345-0@lo:103: 00010000:00010000:1.0:1788863585.781518:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863585.781522:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 25 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.781531:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 25 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.781542:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863585.781570:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3640:x1875759226478848:12345-0@lo:103: Request processed in 61us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.781576:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863585.781614:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226478848:0@lo:103: 00000100:00100000:3.0:1788863585.781684:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:3.0:1788863585.781698:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454848:12345-192.168.204.35@tcp:400: 00000100:00100000:3.0:1788863585.781981:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454848:12345-192.168.204.35@tcp:400: Request processed in 285us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.781989:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00010000:00010000:2.0:1788863585.782019:0:10349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.782034:0:10349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 24 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782046:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226478976:0@lo:104: 00000100:00100000:2.0:1788863585.782110:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.782115:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788863585.782126:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454976:12345-192.168.204.35@tcp:400: 00000100:00100000:2.0:1788863585.782137:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860180 going to sleep for 11 seconds 00000100:00100000:3.0:1788863585.782161:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454976:12345-192.168.204.35@tcp:400: Request processed in 37us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.782167:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788863585.782191:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454720 00000100:00100000:3.0:1788863585.782196:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454720 00000100:00100000:3.0:1788863585.782230:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788863585.782237:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454720:12345-192.168.204.35@tcp:400: 00000100:00100000:3.0:1788863585.782268:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205454720:12345-192.168.204.35@tcp:400: Request processed in 31us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.782274:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00080000:3.0:1788863585.782294:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863585.782300:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863585.782306:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226476672:192.168.204.35@tcp:104: 00000100:00080000:3.0:1788863585.782314:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863585.782324:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226476800:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863585.782338:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031c00/0xf569beb9d4b68ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68cdd expref: 24 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782353:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226476928:0@lo:104: 00000100:00100000:3.0:1788863585.782365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788863585.782368:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68cb3 expref: 23 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782380:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477184:0@lo:104: 00010000:00010000:2.0:1788863585.782393:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68c97 expref: 22 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782403:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477312:0@lo:104: 00010000:00010000:2.0:1788863585.782417:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68c6d expref: 21 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782428:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477440:0@lo:104: 00000100:00100000:3.0:1788863585.782437:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00010000:2.0:1788863585.782443:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b68c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68c51 expref: 20 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782463:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477568:0@lo:104: 00000100:00100000:2.0:1788863585.782477:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477696:0@lo:104: 00010000:00010000:2.0:1788863585.782486:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68c35 expref: 19 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782494:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477824:0@lo:104: 00010000:00010000:2.0:1788863585.782501:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031000/0xf569beb9d4b68bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68bf6 expref: 18 pid: 6530 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.782509:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226477952:0@lo:104: 00000100:00100000:1.0:1788863585.782715:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226478976 00000100:00100000:1.0:1788863585.782720:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226478976 00000100:00100000:1.0:1788863585.782750:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863585.782757:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226478976:12345-0@lo:104: 00010000:00010000:1.0:1788863585.782770:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.782869:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863585.782875:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10349:x1875759226478976:12345-0@lo:104: Request processed in 120us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863585.782882:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788863585.782914:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863585.782922:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.782929:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863585.782934:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.782944:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863585.782951:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863585.782957:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863585.782988:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.783006:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863585.783024:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.783030:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640031600/0xf569beb9d4b68bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bd3 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863585.783046:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863585.783047:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863585.783049:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863585.783062:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863585.783098:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226479104:0@lo:103: 00000100:00100000:1.0:1788863585.783136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.783152:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205455232 00000100:00100000:3.0:1788863585.783159:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205455232 00010000:00010000:3.0:1788863585.783181:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 10 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863585.783194:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205455104 00000100:00100000:1.0:1788863585.783200:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205455104 00000100:00100000:3.0:1788863585.783201:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226479104 00000100:00100000:3.0:1788863585.783206:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226479104 00010000:00010000:3.0:1788863585.783222:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 18 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863585.783235:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:3.0:1788863585.783243:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed3e4520-177d-4764-9911-f67f7853934a+11:2408:x1875759205455232:12345-192.168.204.35@tcp:103: 00010000:00010000:3.0:1788863585.783254:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863585.783259:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 11 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.783268:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 11 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.783282:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d3e expref: 11 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.783295:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863585.783324:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed3e4520-177d-4764-9911-f67f7853934a+10:2408:x1875759205455232:12345-192.168.204.35@tcp:103: Request processed in 82us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.783331:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:3.0:1788863585.783342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788863585.783351:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 9 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863585.783357:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:3640:x1875759226479104:12345-0@lo:103: 00010000:00010000:3.0:1788863585.783370:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788863585.783377:0:10355:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788863585.783386:0:10355:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1788863585.783569:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 18 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.783579:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 18 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.783590:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863585.783660:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 18 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.783676:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640030800/0xf569beb9d4b68c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68c43 expref: 18 pid: 6529 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863585.783686:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863585.783696:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:3640:x1875759226479104:12345-0@lo:103: Request processed in 339us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.783704:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788863585.783721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:3.0:1788863585.783734:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed3e4520-177d-4764-9911-f67f7853934a+9:2408:x1875759205455104:12345-192.168.204.35@tcp:103: 00000100:00100000:0.0:1788863585.783734:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:3642:x1875759226478592:12345-0@lo:103: Request processed in 5536us (8864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863585.783748:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863585.783822:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226477056:0@lo:103: 00000100:00100000:0.0:1788863585.783934:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205454464 00000100:00100000:0.0:1788863585.783939:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205454464 00000100:00100000:0.0:1788863585.783980:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 198 00000100:00100000:0.0:1788863585.783987:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205454464:12345-192.168.204.35@tcp:400: 00000100:00100000:0.0:1788863585.784019:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205454464:12345-192.168.204.35@tcp:400: Request processed in 33us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863585.784026:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 198 00000100:00100000:1.0:1788863585.784192:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226478592:0@lo:103: 00000100:00100000:1.0:1788863585.784344:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226479104:0@lo:103: 00010000:00010000:2.0:1788863585.784829:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115800/0xf569beb9d4b68bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68bcc expref: 15 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863585.784845:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10349:1875759226478976:0@lo:104: 00010000:00010000:2.0:1788863585.784902:0:10349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.787329:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863585.787351:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 9 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.787371:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 9 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.787394:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d45 expref: 9 pid: 6532 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.787994:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788008:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788060:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788068:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788102:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788110:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788118:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863585.788123:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788133:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788153:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.788166:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863585.788255:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed3e4520-177d-4764-9911-f67f7853934a+8:2408:x1875759205455104:12345-192.168.204.35@tcp:103: Request processed in 4522us (5815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.788267:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00010000:00010000:2.0:1788863585.788415:0:10349:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.788425:0:10349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863585.788432:0:10349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68d38 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863586.283496:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226479232:0@lo:13: 00000100:00100000:1.0:1788863586.283608:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863586.284644:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226479232 00000100:00100000:0.0:1788863586.284660:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226479232 00000100:00100000:0.0:1788863586.284812:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863586.284830:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226479232:12345-0@lo:13: 00002000:00000024:0.0:1788863586.284877:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788863586.284898:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863586.284992:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226479232:12345-0@lo:13: Request processed in 169us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863586.285000:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788863586.285042:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f1880 x1875759226479232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863586.285068:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226479232:0@lo:13: 00000100:00100000:3.0:1788863586.286106:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226479360:0@lo:13: 00000100:00100000:3.0:1788863586.286177:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863586.287518:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226479360 00000100:00100000:1.0:1788863586.287534:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226479360 00000100:00100000:1.0:1788863586.287641:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863586.287653:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226479360:12345-0@lo:13: 00002000:00000024:1.0:1788863586.287722:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863586.287847:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226479360:12345-0@lo:13: Request processed in 196us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863586.287857:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788863586.288240:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438c3100 x1875759226479360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863586.288282:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226479360:0@lo:13: 00000100:00080000:3.0:1788863586.288992:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863586.475494:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863586.796190:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226479872:0@lo:400: 00000100:00100000:3.0:1788863586.796240:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226479744:0@lo:400: 00000100:00100000:0.0:1788863586.796296:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863586.796364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863586.796390:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226480384:0@lo:400: 00000100:00100000:3.0:1788863586.796404:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226480256:0@lo:400: 00000100:00100000:0.0:1788863586.796421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863586.796443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863586.796469:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226480768:0@lo:400: 00000100:00100000:3.0:1788863586.796499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863586.796509:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226479872 00000100:00100000:0.0:1788863586.796520:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226479872 00000100:00100000:3.0:1788863586.796539:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480384 00000100:00100000:3.0:1788863586.796545:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480384 00000100:00100000:0.0:1788863586.796576:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480256 00000100:00100000:0.0:1788863586.796580:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480256 00000100:00100000:3.0:1788863586.796595:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788863586.796608:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226479872:12345-0@lo:400: 00000100:00100000:0.0:1788863586.796629:0:6537:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788863586.796640:0:6537:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788863586.796657:0:6538:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788863586.796668:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788863586.796680:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226479872:12345-0@lo:400: Request processed in 72us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863586.796680:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226480384:12345-0@lo:400: 00000100:00100000:3.0:1788863586.796695:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788863586.796716:0:6536:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788863586.796726:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863586.796727:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226480384:12345-0@lo:400: Request processed in 49us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863586.796737:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226480256:12345-0@lo:400: 00000100:00100000:0.0:1788863586.796738:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788863586.796786:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226480256:12345-0@lo:400: Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863586.796792:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863586.796800:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226479872:0@lo:400: 00000100:00100000:0.0:1788863586.796814:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226480384:0@lo:400: 00000100:00100000:0.0:1788863586.796857:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480768 00000100:00100000:0.0:1788863586.796861:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480768 00000100:00100000:0.0:1788863586.796905:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863586.796913:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226480768:12345-0@lo:400: 00000100:00100000:0.0:1788863586.796947:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226480768:12345-0@lo:400: Request processed in 36us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863586.796954:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788863586.796978:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863586.796983:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863586.796986:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863586.797162:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226479616:0@lo:400: 00000100:00100000:2.0:1788863586.797210:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863586.797232:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226480128:0@lo:400: 00000100:00100000:2.0:1788863586.797253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863586.797263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226480640:0@lo:400: 00000100:00100000:2.0:1788863586.797281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863586.797303:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788863586.797309:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226479488:0@lo:400: 00000100:00100000:2.0:1788863586.797338:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863586.797366:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226480000:0@lo:400: 00000100:00100000:2.0:1788863586.797391:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863586.797411:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226480512:0@lo:400: 00000100:00100000:2.0:1788863586.797431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863586.797455:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226479744 00000100:00100000:2.0:1788863586.797460:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226479744 00000100:00100000:2.0:1788863586.797489:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480000 00000100:00100000:2.0:1788863586.797492:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480000 00000100:00100000:2.0:1788863586.797507:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788863586.797514:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226479744:12345-0@lo:400: 00000100:00100000:0.0:1788863586.797701:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863586.797716:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226480000:12345-0@lo:400: 00000100:00100000:0.0:1788863586.797769:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226480000:12345-0@lo:400: Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863586.797775:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863586.797796:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226479616 00000100:00100000:0.0:1788863586.797800:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226479616 00000100:00100000:0.0:1788863586.797814:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480128 00000100:00100000:1.0:1788863586.797909:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226480000:0@lo:400: 00000100:00100000:3.0:1788863586.797911:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480512 00000100:00100000:3.0:1788863586.797919:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480512 00000100:00100000:3.0:1788863586.798026:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788863586.798035:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226479616:12345-0@lo:400: 00000100:00100000:0.0:1788863586.798058:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480128 00000100:00100000:3.0:1788863586.798108:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226479616:12345-0@lo:400: Request processed in 75us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863586.799188:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226479744:12345-0@lo:400: Request processed in 1670us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863586.799198:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788863586.799244:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226479488 00000100:00100000:2.0:1788863586.799251:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226479488 00000100:00100000:2.0:1788863586.799294:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788863586.799302:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3641:x1875759226479488:12345-0@lo:400: 00000100:00100000:2.0:1788863586.799337:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:3641:x1875759226479488:12345-0@lo:400: Request processed in 37us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863586.799357:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788863586.799403:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788863586.799416:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226480512:12345-0@lo:400: 00000100:00100000:2.0:1788863586.799424:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480640 00000100:00100000:2.0:1788863586.799428:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480640 00000100:00100000:1.0:1788863586.799457:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226480512:12345-0@lo:400: Request processed in 47us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863586.799458:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788863586.799464:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788863586.799465:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226480640:12345-0@lo:400: 00000100:00100000:2.0:1788863586.799497:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226480640:12345-0@lo:400: Request processed in 33us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863586.799502:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863586.799543:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226479488:0@lo:400: 00010000:00080000:2.0:1788863586.799561:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01500 x1875759226480512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863586.799577:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226480512:0@lo:400: 00000100:00100000:2.0:1788863586.799594:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226479616:0@lo:400: 00010000:00080000:2.0:1788863586.799607:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01f80 x1875759226480640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863586.799615:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226480640:0@lo:400: 00000100:00080000:2.0:1788863586.799701:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863586.799707:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863586.799710:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863586.799723:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226479744:0@lo:400: 00010000:00080000:1.0:1788863586.799739:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01880 x1875759226480256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863586.799748:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226480256:0@lo:400: 00010000:00080000:1.0:1788863586.799762:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d00000 x1875759226480768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863586.799769:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226480768:0@lo:400: 00000100:00100000:3.0:1788863586.800680:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788863586.800723:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788863586.800740:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226480128:12345-0@lo:400: 00000100:00100000:3.0:1788863586.800970:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226480128:12345-0@lo:400: Request processed in 238us (3715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863586.800978:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788863586.801148:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226480128:0@lo:400: 10000000:01000000:1.0:1788863587.116155:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788863587.116167:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e67aeee000 from 48 10000000:01000000:1.0:1788863587.116174:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863587.116257:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.116282:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.116320:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863587.116356:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226480896:0@lo:101: 00000100:00100000:1.0:1788863587.116457:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.116563:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.116591:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226480896 00000100:00100000:2.0:1788863587.116603:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226480896 00000100:00100000:2.0:1788863587.116676:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788863587.116687:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+15:6534:x1875759226480896:12345-0@lo:101: 00010000:00010000:2.0:1788863587.116715:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863587.116734:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68d3f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.116765:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68d3f expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.116777:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68d3f expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.116787:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98e00, rc 0) 00000100:00100000:2.0:1788863587.117017:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226480896:12345-0@lo:101: Request processed in 332us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.117025:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788863587.117636:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226480896:0@lo:101: 00010000:00010000:1.0:1788863587.117658:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.117669:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863587.117761:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481024:0@lo:501: 00000100:00100000:1.0:1788863587.117800:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.117981:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.118056:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481024 00000100:00100000:2.0:1788863587.118063:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481024 00000100:00100000:2.0:1788863587.118404:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788863587.118416:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226481024:12345-0@lo:501: 00000100:00100000:2.0:1788863587.118673:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226481024:12345-0@lo:501: Request processed in 258us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.118681:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788863587.119381:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481024:0@lo:501: 00000100:00100000:1.0:1788863587.119442:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481152:0@lo:503: 00000100:00100000:1.0:1788863587.119519:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.119565:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.120016:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481152 00000100:00100000:0.0:1788863587.120028:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481152 00000100:00100000:0.0:1788863587.120203:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788863587.120527:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226481152:12345-0@lo:503: 00000100:00100000:0.0:1788863587.120741:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226481152:12345-0@lo:503: Request processed in 220us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.121457:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481152:0@lo:503: 00000100:00100000:3.0:1788863587.122584:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10369:1875759226481280:0@lo:502: 00000100:00100000:3.0:1788863587.122688:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.122736:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542577c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.131974:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481280 00000100:00100000:2.0:1788863587.132001:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481280 00000100:00100000:2.0:1788863587.132068:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788863587.132104:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10369:x1875759226481280:12345-0@lo:502: 00000100:00100000:2.0:1788863587.132402:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10369:x1875759226481280:12345-0@lo:502: Request processed in 309us (9712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.132412:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788863587.132757:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10369:1875759226481280:0@lo:502: 00000100:00100000:3.0:1788863587.132857:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10369:1875759226481408:0@lo:502: 00000100:00100000:3.0:1788863587.132927:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.132984:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681c5e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.134151:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481408 00000100:00100000:2.0:1788863587.134167:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481408 00000100:00100000:2.0:1788863587.134243:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788863587.134255:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10369:x1875759226481408:12345-0@lo:502: 00000100:00100000:2.0:1788863587.134578:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10369:x1875759226481408:12345-0@lo:502: Request processed in 324us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.134588:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788863587.135108:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10369:1875759226481408:0@lo:502: 00000040:00080000:3.0:1788863587.135157:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788863587.135519:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788863587.135549:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863587.135562:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.135574:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863587.135586:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788863587.135589:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788863587.135593:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788863587.135639:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.135648:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.135658:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863587.135678:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481536:0@lo:101: 00000100:00100000:2.0:1788863587.135736:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.135895:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860480 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.139170:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788863587.139707:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481536 00000100:00100000:0.0:1788863587.139730:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481536 00000100:00100000:3.0:1788863587.139912:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788863587.139930:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+16:6534:x1875759226481536:12345-0@lo:101: 00010000:00010000:3.0:1788863587.139952:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863587.141995:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68d4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.142051:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68d4d expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.142280:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68d4d expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.142363:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167c800, rc 0) 00000100:00100000:3.0:1788863587.142494:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226481536:12345-0@lo:101: Request processed in 2569us (6756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.142504:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788863587.142649:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481536:0@lo:101: 00010000:00010000:2.0:1788863587.142674:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.142686:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863587.142794:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481664:0@lo:501: 00000100:00100000:2.0:1788863587.142835:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.142895:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863587.142949:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481664 00000100:00100000:3.0:1788863587.142957:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481664 00000100:00100000:3.0:1788863587.142994:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788863587.143003:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226481664:12345-0@lo:501: 00000100:00100000:3.0:1788863587.143437:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226481664:12345-0@lo:501: Request processed in 433us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.143446:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788863587.143532:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481664:0@lo:501: 00000100:00100000:2.0:1788863587.143568:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481792:0@lo:503: 00000100:00100000:2.0:1788863587.143621:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.143657:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860480 going to sleep for 11 seconds 00000100:00100000:1.0:1788863587.143706:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481792 00000100:00100000:1.0:1788863587.143711:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481792 00000100:00100000:1.0:1788863587.143748:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788863587.143755:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226481792:12345-0@lo:503: 00000100:00100000:1.0:1788863587.143883:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226481792:12345-0@lo:503: Request processed in 128us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.143898:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788863587.144268:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226481792:0@lo:503: 00000100:00100000:2.0:1788863587.144908:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10370:1875759226481920:0@lo:502: 00000100:00100000:2.0:1788863587.144982:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.145067:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.145841:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226481920 00000100:00100000:0.0:1788863587.145854:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226481920 00000100:00100000:0.0:1788863587.145920:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788863587.145931:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10370:x1875759226481920:12345-0@lo:502: 00000100:00100000:0.0:1788863587.146135:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10370:x1875759226481920:12345-0@lo:502: Request processed in 206us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.146143:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788863587.146664:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10370:1875759226481920:0@lo:502: 00000020:01000000:2.0:1788863587.146709:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863587.146722:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863587.146725:0:10370:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788863587.146731:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788863587.146774:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10370:1875759226482048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863587.146836:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.146899:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.147063:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482048 00000100:00100000:0.0:1788863587.147070:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482048 00000100:00100000:0.0:1788863587.147248:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788863587.147255:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10370:x1875759226482048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863587.147552:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:10370:x1875759226482048:12345-0@lo:502:llog_process_th.0 Request processed in 296us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.147560:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788863587.147662:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10370:1875759226482048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863587.147691:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863587.147696:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863587.147698:0:10370:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788863587.147704:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788863587.147931:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788863587.147956:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788863587.147968:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.147983:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863587.147997:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788863587.148000:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e67afa4000 from 48 10000000:01000000:3.0:1788863587.148005:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788863587.148046:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.148068:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.148129:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863587.148156:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.148204:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.148253:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542577c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.148532:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482176 00000100:00100000:2.0:1788863587.148540:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482176 00000100:00100000:2.0:1788863587.148588:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788863587.148598:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+17:6534:x1875759226482176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863587.148610:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863587.148625:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99a00/0xf569beb9d4b68d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68d5b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.148654:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99a00/0xf569beb9d4b68d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68d5b expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.148667:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99a00/0xf569beb9d4b68d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68d5b expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.148676:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99a00, rc 0) 00000100:00100000:2.0:1788863587.148720:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226482176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.148726:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788863587.148845:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863587.148862:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.148884:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863587.148962:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.148991:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.149014:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542577c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.149053:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482304 00000100:00100000:2.0:1788863587.149057:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482304 00000100:00100000:2.0:1788863587.149155:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788863587.149162:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226482304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.149535:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226482304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.149567:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788863587.149717:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.149755:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.149801:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.149972:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542577c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.150020:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482432 00000100:00100000:0.0:1788863587.150026:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482432 00000100:00100000:0.0:1788863587.150058:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788863587.150065:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226482432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.150222:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226482432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.150229:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788863587.150421:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863587.151188:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10371:1875759226482560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.151388:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.151431:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.151496:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482560 00000100:00100000:0.0:1788863587.151503:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482560 00000100:00100000:0.0:1788863587.151546:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788863587.151554:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:10371:x1875759226482560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863587.151686:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:10371:x1875759226482560:12345-0@lo:502:llog_process_th.0 Request processed in 132us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.151694:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788863587.151795:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10371:1875759226482560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.151847:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10371:1875759226482688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.151891:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.151958:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.152370:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482688 00000100:00100000:0.0:1788863587.152376:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482688 00000100:00100000:0.0:1788863587.152449:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788863587.152458:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:10371:x1875759226482688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863587.152659:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:10371:x1875759226482688:12345-0@lo:502:llog_process_th.0 Request processed in 202us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.152665:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788863587.152765:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10371:1875759226482688:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788863587.152804:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788863587.153032:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788863587.153064:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863587.153430:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.153445:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863587.153456:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788863587.153460:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788863587.153464:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788863587.153504:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.153513:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.153523:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863587.153546:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.153600:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.153685:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863587.153724:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482816 00000100:00100000:3.0:1788863587.153732:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482816 00000100:00100000:3.0:1788863587.153824:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788863587.153834:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+18:6534:x1875759226482816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863587.153848:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863587.153875:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68d69 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.153917:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68d69 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.153929:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68d69 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863587.153939:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167ce00, rc 0) 00000100:00100000:3.0:1788863587.154028:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226482816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.154035:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788863587.157523:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863587.157568:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.157616:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863587.157748:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.157836:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.157894:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863587.158001:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226482944 00000100:00100000:1.0:1788863587.158011:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226482944 00000100:00100000:1.0:1788863587.158119:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788863587.158130:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226482944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863587.158511:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226482944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 381us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.158520:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788863587.159124:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226482944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.159186:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.159266:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.159380:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.159408:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483072 00000100:00100000:2.0:1788863587.159414:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483072 00000100:00100000:2.0:1788863587.159452:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788863587.159460:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226483072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.159584:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226483072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.159591:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788863587.159641:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.166635:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10372:1875759226483200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863587.166765:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.166900:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.174224:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483200 00000100:00100000:2.0:1788863587.174252:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483200 00000100:00100000:2.0:1788863587.174576:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788863587.174590:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:10372:x1875759226483200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863587.175035:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:10372:x1875759226483200:12345-0@lo:502:llog_process_th.0 Request processed in 446us (8268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.175057:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788863587.175317:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10372:1875759226483200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863587.175372:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863587.175387:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863587.175389:0:10372:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788863587.175396:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788863587.175445:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10372:1875759226483328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863587.175510:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.175564:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863587.175703:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483328 00000100:00100000:3.0:1788863587.175711:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483328 00000100:00100000:3.0:1788863587.175761:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788863587.175770:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:10372:x1875759226483328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863587.175889:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:10372:x1875759226483328:12345-0@lo:502:llog_process_th.0 Request processed in 120us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.175896:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788863587.176235:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10372:1875759226483328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863587.181274:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863587.182201:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863587.182207:0:10372:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788863587.182219:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788863587.182568:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788863587.182598:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788863587.182613:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.182628:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863587.182641:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788863587.182644:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e648f4b800 from 48 10000000:01000000:0.0:1788863587.182648:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863587.182704:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.182713:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.182726:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863587.182762:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.182861:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.182938:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863587.183024:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483456 00000100:00100000:1.0:1788863587.183035:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483456 00000100:00100000:1.0:1788863587.183491:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788863587.183504:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:6534:x1875759226483456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863587.183523:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863587.183539:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114000/0xf569beb9d4b68d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68d77 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.183595:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114000/0xf569beb9d4b68d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68d77 expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.183608:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114000/0xf569beb9d4b68d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68d77 expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.183618:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114000, rc 0) 00000100:00100000:1.0:1788863587.183687:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226483456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.183695:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788863587.183931:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863587.183950:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.183968:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863587.184062:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.184134:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.184172:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.186242:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483584 00000100:00100000:2.0:1788863587.186264:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483584 00000100:00100000:2.0:1788863587.186360:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788863587.186372:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226483584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.186607:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226483584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.186616:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788863587.186848:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.186929:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.186994:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.187046:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863587.187159:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483712 00000100:00100000:3.0:1788863587.187166:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483712 00000100:00100000:3.0:1788863587.187214:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788863587.187222:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226483712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.187337:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226483712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.187343:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788863587.187541:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226483712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863587.188643:0:10373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10373:1875759226483840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.188727:0:10373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.188777:0:10373:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863587.189247:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483840 00000100:00100000:3.0:1788863587.189259:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483840 00000100:00100000:3.0:1788863587.189435:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788863587.189446:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:10373:x1875759226483840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863587.189709:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:10373:x1875759226483840:12345-0@lo:502:llog_process_th.0 Request processed in 265us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.189719:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788863587.190841:0:10373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10373:1875759226483840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863587.191612:0:10373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10373:1875759226483968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863587.191712:0:10373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.191812:0:10373:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.191862:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226483968 00000100:00100000:2.0:1788863587.191880:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226483968 00000100:00100000:2.0:1788863587.191978:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788863587.191989:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:10373:x1875759226483968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863587.192672:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:10373:x1875759226483968:12345-0@lo:502:llog_process_th.0 Request processed in 681us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.192682:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788863587.192783:0:10373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10373:1875759226483968:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788863587.192825:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788863587.201397:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788863587.201463:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788863587.201480:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.201496:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863587.201511:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788863587.201515:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788863587.201519:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788863587.201577:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.201587:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.201620:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863587.201658:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.201755:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.201824:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863587.202048:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484096 00000100:00100000:1.0:1788863587.202059:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484096 00000100:00100000:1.0:1788863587.202281:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788863587.203284:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226484096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863587.203385:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863587.203408:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650115a00/0xf569beb9d4b68d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68d85 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.203448:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650115a00/0xf569beb9d4b68d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68d85 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.203462:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650115a00/0xf569beb9d4b68d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68d85 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.203490:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650115a00, rc 0) 00000100:00100000:1.0:1788863587.203584:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226484096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.203593:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788863587.203811:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863587.203833:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.203845:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863587.203973:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.204013:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.204061:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.204386:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484224 00000100:00100000:2.0:1788863587.204394:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484224 00000100:00100000:2.0:1788863587.204471:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788863587.204481:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226484224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.204648:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226484224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.204656:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788863587.204729:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.204769:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.204827:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.207676:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.207799:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484352 00000100:00100000:2.0:1788863587.209720:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484352 00000100:00100000:2.0:1788863587.209860:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788863587.209884:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226484352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.210146:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226484352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (5317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.210156:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788863587.210448:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.213251:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10374:1875759226484480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863587.213376:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.213436:0:10374:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.213923:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484480 00000100:00100000:0.0:1788863587.213934:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484480 00000100:00100000:0.0:1788863587.214001:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788863587.214012:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10374:x1875759226484480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863587.214250:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10374:x1875759226484480:12345-0@lo:502:llog_process_th.0 Request processed in 239us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.214259:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788863587.214552:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10374:1875759226484480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863587.214592:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863587.214604:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863587.214607:0:10374:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788863587.214615:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788863587.214649:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10374:1875759226484608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863587.214692:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.214730:0:10374:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863587.214777:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484608 00000100:00100000:3.0:1788863587.214782:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484608 00000100:00100000:3.0:1788863587.214810:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788863587.214817:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10374:x1875759226484608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863587.214916:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10374:x1875759226484608:12345-0@lo:502:llog_process_th.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.214922:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788863587.215332:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10374:1875759226484608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863587.215356:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863587.215361:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863587.215363:0:10374:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788863587.215367:0:10374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788863587.215594:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788863587.215623:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788863587.215636:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.215649:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863587.215662:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788863587.215666:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e64a89a800 from 48 10000000:01000000:0.0:1788863587.215669:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863587.215709:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.215718:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.215728:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863587.215748:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.215799:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.215892:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863587.217069:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484736 00000100:00100000:1.0:1788863587.217163:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484736 00000100:00100000:1.0:1788863587.217303:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788863587.217314:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226484736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863587.217338:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863587.217360:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114200/0xf569beb9d4b68d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68d93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.217408:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114200/0xf569beb9d4b68d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68d93 expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.217422:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114200/0xf569beb9d4b68d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68d93 expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.217433:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114200, rc 0) 00000100:00100000:1.0:1788863587.217523:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226484736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.217530:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788863587.217656:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863587.217677:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.217688:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863587.217804:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.217841:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.217898:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.217931:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484864 00000100:00100000:0.0:1788863587.217937:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484864 00000100:00100000:0.0:1788863587.217972:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788863587.217987:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226484864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.218165:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226484864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.218172:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788863587.219655:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.219731:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.219813:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.220405:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226484992 00000100:00100000:3.0:1788863587.220425:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226484992 00000100:00100000:3.0:1788863587.220496:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788863587.220507:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226484992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.220649:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226484992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.220658:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788863587.222881:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.222944:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226484992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863587.230506:0:10375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10375:1875759226485120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.230630:0:10375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.230699:0:10375:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863587.230789:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226485120 00000100:00100000:3.0:1788863587.230800:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226485120 00000100:00100000:3.0:1788863587.230857:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788863587.230878:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:10375:x1875759226485120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.231368:0:10375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10375:1875759226485120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.231442:0:10375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10375:1875759226485248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863587.231491:0:10375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.231524:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226485248 00000100:00100000:1.0:1788863587.231526:0:10375:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.231529:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226485248 00000100:00100000:2.0:1788863587.231570:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788863587.231578:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10375:x1875759226485248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863587.231674:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10375:x1875759226485248:12345-0@lo:502:llog_process_th.0 Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.231683:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788863587.232509:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10375:x1875759226485120:12345-0@lo:502:llog_process_th.0 Request processed in 1628us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863587.232520:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788863587.233917:0:10375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10375:1875759226485248:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788863587.233974:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788863587.234187:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788863587.234212:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863587.234226:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.234242:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863587.234255:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788863587.234275:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788863587.234279:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788863587.234805:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.234816:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.234829:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863587.234860:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226485376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.234962:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.235138:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.241553:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226485376 00000100:00100000:0.0:1788863587.241576:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226485376 00000100:00100000:0.0:1788863587.241672:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788863587.241685:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226485376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863587.241723:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863587.241753:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68da1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.241794:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68da1 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.241807:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68da1 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.241817:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90400, rc 0) 00000100:00100000:0.0:1788863587.241944:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226485376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.241952:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788863587.242402:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226485376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863587.242429:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.242442:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863587.242558:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226485504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863587.242607:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.242652:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226485504 00000100:00100000:2.0:1788863587.242658:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226485504 00000100:00100000:1.0:1788863587.242658:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.242701:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788863587.242709:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226485504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.242892:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226485504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.242900:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788863587.243029:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226485504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.243106:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226485632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.243180:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.243196:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863587.243914:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226485632 00000100:00100000:1.0:1788863587.243923:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226485632 00000100:00100000:1.0:1788863587.243965:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788863587.243974:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226485632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863587.244151:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226485632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.244159:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788863587.244600:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226485632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863587.245503:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10376:1875759226485760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863587.245576:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.245630:0:10376:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.245813:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226485760 00000100:00100000:0.0:1788863587.245823:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226485760 00000100:00100000:0.0:1788863587.245886:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788863587.245897:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10376:x1875759226485760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863587.246040:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10376:x1875759226485760:12345-0@lo:502:llog_process_th.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.246056:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788863587.246919:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10376:1875759226485760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863587.246973:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863587.246988:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863587.247004:0:10376:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788863587.247013:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788863587.247056:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10376:1875759226485888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863587.247168:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863587.247211:0:10376:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.247509:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226485888 00000100:00100000:2.0:1788863587.247517:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226485888 00000100:00100000:2.0:1788863587.247572:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788863587.247583:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10376:x1875759226485888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863587.247789:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10376:x1875759226485888:12345-0@lo:502:llog_process_th.0 Request processed in 209us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.247798:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788863587.249975:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10376:1875759226485888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863587.250043:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863587.250057:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863587.250061:0:10376:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788863587.250068:0:10376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788863587.250290:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788863587.250322:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788863587.250337:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.250366:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863587.250379:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788863587.250382:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89e671354d40 from 1 10000000:01000000:1.0:1788863587.250385:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788863587.250437:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.250447:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863587.250458:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863587.250497:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226486016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863587.250577:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.250630:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863587.250747:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226486016 00000100:00100000:2.0:1788863587.250757:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226486016 00000100:00100000:2.0:1788863587.250809:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788863587.250889:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226486016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863587.250907:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863587.250925:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98400/0xf569beb9d4b68db6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68daf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.250956:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98400/0xf569beb9d4b68db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68daf expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.250970:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98400/0xf569beb9d4b68db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68daf expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.250980:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98400, rc 0) 00000100:00100000:2.0:1788863587.251033:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226486016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.251732:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226486016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863587.251754:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68db6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.251765:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68db6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863587.251852:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226486144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.251905:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863587.251940:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6763026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863587.251956:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226486144 00000100:00100000:0.0:1788863587.251961:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226486144 00000100:00100000:2.0:1788863587.254257:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788863587.254651:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788863587.254672:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226486144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863587.254888:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226486144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (2982us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863587.254896:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788863587.254992:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226486144:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788863587.255055:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788863587.255068:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68db6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.255668:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68db6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863587.307425:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226486272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863587.307530:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.307979:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226486272 00000100:00100000:2.0:1788863587.307990:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226486272 00000100:00100000:2.0:1788863587.308053:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788863587.308463:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226486400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863587.308517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.309205:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226486272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863587.309245:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863587.309328:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226486272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.309336:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788863587.309363:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226486400 00000100:00100000:2.0:1788863587.309370:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226486400 00000100:00100000:2.0:1788863587.309406:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788863587.309414:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226486400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863587.309424:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863587.309455:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226486400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.309461:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788863587.309509:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef5180 x1875759226486400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863587.309530:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226486400:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788863587.312254:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f0000 x1875759226486272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863587.312292:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226486272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863587.499581:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863587.692962:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863587.693144:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205455360 00000100:00100000:2.0:1788863587.693162:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205455360 00000100:00100000:2.0:1788863587.693249:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 242 00000100:00100000:2.0:1788863587.693263:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+8:6188:x1875759205455360:12345-192.168.204.35@tcp:101: 00010000:00010000:2.0:1788863587.693288:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863587.693320:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99000/0xf569beb9d4b68dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187db5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.693369:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99000/0xf569beb9d4b68dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187db5 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.693413:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99000/0xf569beb9d4b68dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187db5 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863587.693427:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99000, rc 0) 00000100:00100000:2.0:1788863587.693541:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+9:6188:x1875759205455360:12345-192.168.204.35@tcp:101: Request processed in 281us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.693550:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 242 00000100:00100000:1.0:1788863587.696464:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863587.696611:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205455488 00000100:00100000:0.0:1788863587.696635:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205455488 00000100:00100000:0.0:1788863587.696714:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:0.0:1788863587.696727:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+9:6188:x1875759205455488:12345-192.168.204.35@tcp:501: 00000100:00100000:0.0:1788863587.697158:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+9:6188:x1875759205455488:12345-192.168.204.35@tcp:501: Request processed in 433us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.697166:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:3.0:1788863587.700833:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863587.701249:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205455616 00000100:00100000:1.0:1788863587.701264:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205455616 00000100:00100000:1.0:1788863587.701361:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 244 00000100:00100000:1.0:1788863587.701374:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:6188:x1875759205455616:12345-192.168.204.35@tcp:503: 00000100:00100000:1.0:1788863587.701582:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:6188:x1875759205455616:12345-192.168.204.35@tcp:503: Request processed in 210us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.701591:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 244 00000100:00100000:1.0:1788863587.707289:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863587.707515:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205455744 00000100:00100000:2.0:1788863587.707535:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205455744 00000100:00100000:2.0:1788863587.707958:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:2.0:1788863587.707976:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+9:6666:x1875759205455744:12345-192.168.204.35@tcp:502: 00000100:00100000:2.0:1788863587.708261:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+9:6666:x1875759205455744:12345-192.168.204.35@tcp:502: Request processed in 290us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.708271:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:3.0:1788863587.715897:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863587.717489:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205455872 00000100:00100000:1.0:1788863587.717513:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205455872 00000100:00100000:1.0:1788863587.717633:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 246 00000100:00100000:1.0:1788863587.717647:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:6666:x1875759205455872:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863587.717930:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:6666:x1875759205455872:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 285us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.717941:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 246 00000100:00100000:3.0:1788863587.723177:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863587.723443:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456000 00000100:00100000:0.0:1788863587.723460:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456000 00000100:00100000:0.0:1788863587.723540:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:0.0:1788863587.723551:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+9:6188:x1875759205456000:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863587.723576:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863587.723604:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d90c00/0xf569beb9d4b68dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187dbc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.723668:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d90c00/0xf569beb9d4b68dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dbc expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.723685:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d90c00/0xf569beb9d4b68dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dbc expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863587.723699:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90c00, rc 0) 00000100:00100000:0.0:1788863587.723868:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205456000:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 307us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863587.723877:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:0.0:1788863587.729052:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863587.729393:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456128 00000100:00100000:2.0:1788863587.729408:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456128 00000100:00100000:2.0:1788863587.729484:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 248 00000100:00100000:2.0:1788863587.729497:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205456128:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863587.729690:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205456128:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 189us (646us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863587.729700:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 248 00000100:00100000:0.0:1788863587.821926:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863587.821960:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226486528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863587.822071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863587.822847:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226486528 00000100:00100000:1.0:1788863587.822872:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226486528 00000100:00100000:1.0:1788863587.822954:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788863587.822968:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226486528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863587.823022:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788863587.823124:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226486528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863587.823133:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788863587.823200:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226486528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863587.823844:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863587.823874:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226486656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863587.823930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863587.824649:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226486656 00000100:00100000:2.0:1788863587.824659:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226486656 00000100:00100000:2.0:1788863587.824722:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788863587.824732:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226486656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863587.824789:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863587.824864:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226486656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863587.824871:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788863587.824921:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226486656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788863588.523180:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788863589.128913:0:10414:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd94cec7c0 20000000:00000080:2.0:1788863589.128932:0:10414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e542ae1800 uarg=0000000000000000 20000000:01000000:2.0:1788863589.128978:0:10414:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788863589.128983:0:10414:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788863589.128988:0:10414:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788863589.130527:0:10415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788863589.130788:0:10414:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788863589.147641:0:10414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788863589.147689:0:10414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788863589.147705:0:10414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788863589.147722:0:10414:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788863589.147744:0:10414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147764:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e641537400/0xf569beb9d4b68a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147772:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147778:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147785:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147815:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147823:0:10414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147881:0:10414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.147898:0:10414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 9 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863589.147913:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226486784:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863589.148644:0:10414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.148657:0:10414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 23 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863589.148668:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226486912:0@lo:104: 00000100:00100000:2.0:1788863589.148717:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863589.149058:0:10414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.149067:0:10414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 23 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863589.149123:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226486912 00000100:00100000:1.0:1788863589.149133:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226486912 00000100:00100000:1.0:1788863589.149185:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863589.149194:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10414:x1875759226486912:12345-0@lo:104: 00010000:00010000:1.0:1788863589.149207:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149262:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863589.149268:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10414:x1875759226486912:12345-0@lo:104: Request processed in 76us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863589.149289:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788863589.149318:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863589.149324:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149332:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863589.149336:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149359:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863589.149367:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863589.149373:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863589.149408:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149415:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863589.149437:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149444:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98600/0xf569beb9d4b68be8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68bef expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149457:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863589.149459:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863589.149461:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863589.149473:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226487168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863589.149507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863589.149555:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487168 00000100:00100000:1.0:1788863589.149559:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487168 00010000:00010000:1.0:1788863589.149575:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 24 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863589.149596:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863589.149602:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226487168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863589.149612:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863589.149617:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 24 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149627:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 24 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.149642:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863589.149669:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226487168:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863589.149675:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863589.149714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226487168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863589.150502:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226487040:0@lo:104: 00000100:00100000:2.0:1788863589.150589:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863589.150653:0:10414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.150666:0:10414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 23 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863589.150678:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226487296:0@lo:104: 00010000:00010000:2.0:1788863589.150704:0:10414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e641537400/0xf569beb9d4b68a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.150712:0:10414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e641537400/0xf569beb9d4b68a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 23 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863589.150838:0:6520:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788863589.150864:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863589.150877:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487040 00000100:00100000:0.0:1788863589.150882:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487040 00000100:00100000:0.0:1788863589.150912:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487296 00000100:00100000:0.0:1788863589.150915:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487296 00000100:00100000:0.0:1788863589.150926:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788863589.150932:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67ade3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:10414:x1875759226487040:12345-0@lo:104: 00010000:00010000:0.0:1788863589.150943:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863589.150987:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863589.150993:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67ade3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:10414:x1875759226487040:12345-0@lo:104: Request processed in 61us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863589.150999:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788863589.151031:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788863589.151036:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10414:x1875759226487296:12345-0@lo:104: 00010000:00010000:0.0:1788863589.151043:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863589.151070:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788863589.151107:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10414:x1875759226487296:12345-0@lo:104: Request processed in 39us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863589.151112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788863589.151181:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863589.151188:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151195:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863589.151199:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151207:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863589.151221:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863589.151227:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863589.151263:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151269:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863589.151287:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151295:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b68ac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68ac9 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151307:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863589.151311:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151316:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863589.151319:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151326:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863589.151331:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863589.151336:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863589.151367:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151372:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863589.151378:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151384:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641536000/0xf569beb9d4b68a6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a75 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151393:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863589.151395:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863589.151397:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863589.151410:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226487552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863589.151436:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226487424:0@lo:104: 00000100:00100000:1.0:1788863589.151443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863589.151477:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863589.151480:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863589.151487:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226487680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863589.151506:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863589.151514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863589.151527:0:10414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031400/0xf569beb9d4b68bef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68be8 expref: 23 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863589.151542:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226486912:0@lo:104: 00000100:00100000:1.0:1788863589.151544:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487552 00000100:00100000:1.0:1788863589.151550:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487552 00000100:00100000:2.0:1788863589.151555:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226487040:0@lo:104: 00000100:00100000:2.0:1788863589.151566:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226487296:0@lo:104: 00010000:00010000:1.0:1788863589.151569:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 23 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863589.151596:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487680 00000100:00100000:1.0:1788863589.151599:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487680 00000100:00100000:2.0:1788863589.151613:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788863589.151614:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 24 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863589.151629:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226487552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863589.151640:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788863589.151642:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788863589.151651:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226487680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863589.151652:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 24 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151673:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863589.151680:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 24 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.151682:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 24 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.151706:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641537e00/0xf569beb9d4b68ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68ac2 expref: 24 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863589.151818:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487424 00000100:00100000:0.0:1788863589.151822:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487424 00000100:00100000:0.0:1788863589.151853:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788863589.151859:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10414:x1875759226487424:12345-0@lo:104: 00010000:00010000:0.0:1788863589.151867:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863589.151913:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863589.151919:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:10414:x1875759226487424:12345-0@lo:104: Request processed in 60us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863589.151925:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788863589.151984:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863589.151990:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.151997:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863589.152007:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.152015:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863589.152021:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863589.152026:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863589.152099:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 23 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.152109:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114600/0xf569beb9d4b68a75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68a6e expref: 23 pid: 6530 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863589.152122:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863589.152150:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3640:x1875759226487680:12345-0@lo:103:ldlm_bl.0 Request processed in 504us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863589.152157:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863589.152186:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226487680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863589.152208:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863589.152646:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863589.152811:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3640:x1875759226487552:12345-0@lo:103:ldlm_bl.0 Request processed in 1187us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863589.152820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863589.152877:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226487424:0@lo:104: 00010000:00010000:3.0:1788863589.152895:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.152903:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863589.152935:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.152943:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b68a60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68a67 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.152959:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863589.152961:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863589.152962:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863589.152978:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863589.152990:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226487808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863589.153025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863589.153055:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487808 00000100:00100000:3.0:1788863589.153060:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487808 00010000:00010000:3.0:1788863589.153097:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e641537400/0xf569beb9d4b68a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 21 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863589.153121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863589.153140:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3643:x1875759226487808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863589.153152:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863589.153157:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e641537400/0xf569beb9d4b68a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 21 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.153165:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e641537400/0xf569beb9d4b68a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 21 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.153177:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641537400/0xf569beb9d4b68a67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68a60 expref: 21 pid: 6532 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.153185:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863589.153214:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:3643:x1875759226487808:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863589.153220:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863589.153270:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226487808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863589.157334:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863589.157468:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456256 00000100:00100000:3.0:1788863589.157477:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456256 00010000:00010000:3.0:1788863589.157517:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 10 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863589.157560:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:3.0:1788863589.157569:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205456256:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863589.157584:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863589.157590:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 10 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157603:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 10 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157637:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157645:0:10355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157661:0:10355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157668:0:10355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157675:0:10355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157681:0:10355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157687:0:10355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863589.157691:0:10355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157699:0:10355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157707:0:10355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863589.157716:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863589.157770:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205456256:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 202us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863589.157788:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00010000:00010000:2.0:1788863589.160248:0:10414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115400/0xf569beb9d4b68d07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d7d expref: 9 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863589.160272:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1875759226486784:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863589.160316:0:10414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.160325:0:10414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.160331:0:10414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863589.160337:0:10414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b68dcb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863589.162171:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226487552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863589.547742:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863590.571384:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788863590.572697:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788863590.572703:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67aeee000 from 4 10000000:01000000:1.0:1788863590.572709:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863590.572758:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863590.572771:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863590.572783:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863590.572835:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226487936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.573471:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.573584:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863590.580944:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226487936 00000100:00100000:2.0:1788863590.580976:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226487936 00000100:00100000:2.0:1788863590.581122:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788863590.581134:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226487936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863590.581153:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863590.581174:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68dd2 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.581202:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.584038:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.584053:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98600, rc 0) 00000100:00100000:2.0:1788863590.584165:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226487936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3034us (10695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.584174:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788863590.584350:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226487936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863590.584372:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.584383:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863590.584470:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.584499:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.587496:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863590.587592:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488064 00000100:00100000:3.0:1788863590.587615:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488064 00000100:00100000:3.0:1788863590.587663:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788863590.587672:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226488064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863590.587850:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226488064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.587859:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788863590.588336:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.588388:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.588445:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.588474:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863590.588487:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488192 00000100:00100000:0.0:1788863590.588490:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488192 00000100:00100000:0.0:1788863590.588513:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788863590.588520:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226488192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.588613:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226488192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.588630:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788863590.588687:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.588927:0:10455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10455:1875759226488320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863590.588961:0:10455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.588980:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488320 00000100:00100000:0.0:1788863590.588984:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488320 00000100:00100000:0.0:1788863590.589003:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788863590.589009:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10455:x1875759226488320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863590.589101:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10455:x1875759226488320:12345-0@lo:502:llog_process_th.0 Request processed in 91us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.589108:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788863590.589136:0:10455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863590.589148:0:10455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10455:1875759226488320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863590.589172:0:10455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863590.589182:0:10455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863590.589185:0:10455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788863590.589193:0:10455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e67aeee000 00000020:00000080:0.0:1788863590.589195:0:10455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788863590.589285:0:10455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10455:1875759226488448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863590.589314:0:10455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.589329:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488448 00000100:00100000:0.0:1788863590.589333:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488448 00000100:00100000:0.0:1788863590.589347:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788863590.589352:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10455:x1875759226488448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863590.589403:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:10455:x1875759226488448:12345-0@lo:502:llog_process_th.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.589415:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788863590.589438:0:10455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863590.589447:0:10455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10455:1875759226488448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863590.589465:0:10455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863590.589469:0:10455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863590.589470:0:10455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788863590.589473:0:10455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788863590.589517:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788863590.589535:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863590.589544:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.589553:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863590.589563:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863590.589565:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67afa4000 from 4 10000000:01000000:0.0:1788863590.589567:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863590.589589:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.589597:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.589605:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863590.589618:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.589640:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.589656:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863590.589666:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488576 00000100:00100000:0.0:1788863590.589670:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488576 00000100:00100000:0.0:1788863590.589686:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788863590.589691:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226488576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863590.589698:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863590.589709:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68de0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.589728:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.589738:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.589746:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d91e00, rc 0) 00000100:00100000:0.0:1788863590.589773:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226488576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.589778:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788863590.589823:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863590.589834:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.589842:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863590.589883:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.589906:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.589927:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863590.589940:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488704 00000100:00100000:0.0:1788863590.589943:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488704 00000100:00100000:0.0:1788863590.589960:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788863590.589965:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226488704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.590041:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226488704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.590046:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788863590.590070:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.590115:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.590146:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.590159:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863590.590170:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488832 00000100:00100000:0.0:1788863590.590174:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488832 00000100:00100000:0.0:1788863590.590190:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788863590.590195:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226488832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.590253:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226488832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.590260:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788863590.590290:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226488832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.599517:0:10456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10456:1875759226488960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863590.599657:0:10456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.599712:0:10456:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863590.600325:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226488960 00000100:00100000:3.0:1788863590.600334:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226488960 00000100:00100000:3.0:1788863590.600385:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788863590.600394:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:10456:x1875759226488960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863590.600526:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:10456:x1875759226488960:12345-0@lo:502:llog_process_th.0 Request processed in 133us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.600534:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788863590.600724:0:10456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10456:1875759226488960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863590.600752:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863590.600761:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863590.600764:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788863590.600769:0:10456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e67afa4000 00000020:00000080:1.0:1788863590.600772:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788863590.601410:0:10456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10456:1875759226489088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863590.601460:0:10456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.601503:0:10456:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863590.601662:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489088 00000100:00100000:3.0:1788863590.601668:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489088 00000100:00100000:3.0:1788863590.601711:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788863590.601719:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:10456:x1875759226489088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863590.601821:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:10456:x1875759226489088:12345-0@lo:502:llog_process_th.0 Request processed in 103us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.601830:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788863590.602114:0:10456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10456:1875759226489088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863590.602139:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863590.602144:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863590.602146:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788863590.602149:0:10456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788863590.602698:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788863590.602721:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863590.602731:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.602743:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863590.602762:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863590.602764:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e648f4b800 from 4 10000000:01000000:0.0:1788863590.602767:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863590.602810:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.602819:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.602828:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863590.602848:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863590.602888:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.602928:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863590.603295:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489216 00000100:00100000:1.0:1788863590.603302:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489216 00000100:00100000:1.0:1788863590.603447:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788863590.603456:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226489216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863590.603467:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863590.603485:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68dee expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863590.603509:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863590.603521:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863590.603529:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114600, rc 0) 00000100:00100000:1.0:1788863590.603571:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226489216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.603578:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788863590.604838:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863590.604862:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863590.604874:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863590.604951:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.604994:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.605030:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81480 going to sleep for 11 seconds 00000100:00100000:1.0:1788863590.605047:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489344 00000100:00100000:1.0:1788863590.605052:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489344 00000100:00100000:1.0:1788863590.605098:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788863590.605108:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226489344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.605227:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226489344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.605242:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788863590.605283:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.605310:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.605349:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.605365:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81480 going to sleep for 11 seconds 00000100:00100000:1.0:1788863590.605377:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489472 00000100:00100000:1.0:1788863590.605382:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489472 00000100:00100000:1.0:1788863590.605405:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788863590.605410:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226489472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.605490:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226489472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.605496:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788863590.605534:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.607745:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10462:1875759226489600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863590.607827:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.607876:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863590.608151:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489600 00000100:00100000:2.0:1788863590.608160:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489600 00000100:00100000:2.0:1788863590.608203:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788863590.608665:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10462:x1875759226489600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863590.608792:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10462:x1875759226489600:12345-0@lo:502:llog_process_th.0 Request processed in 580us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.608811:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788863590.609860:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10462:1875759226489600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863590.609896:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863590.609923:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863590.609926:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788863590.609933:0:10462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e648f4b800 00000020:00000080:1.0:1788863590.609936:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788863590.610361:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10462:1875759226489728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863590.610412:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.610462:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863590.611240:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489728 00000100:00100000:2.0:1788863590.611250:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489728 00000100:00100000:2.0:1788863590.611303:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788863590.611312:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10462:x1875759226489728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863590.611449:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:10462:x1875759226489728:12345-0@lo:502:llog_process_th.0 Request processed in 134us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.611458:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788863590.611636:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10462:1875759226489728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863590.611663:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863590.611669:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863590.611671:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788863590.611675:0:10462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788863590.613622:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788863590.613662:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863590.613674:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.613687:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863590.613699:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788863590.613701:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e64a89a800 from 4 10000000:01000000:2.0:1788863590.613704:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863590.613744:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.613752:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.613763:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863590.613789:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863590.613859:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.613906:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860180 going to sleep for 11 seconds 00000100:00100000:3.0:1788863590.616567:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489856 00000100:00100000:3.0:1788863590.616582:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489856 00000100:00100000:3.0:1788863590.616657:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788863590.616668:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226489856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863590.616694:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863590.616713:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68dfc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863590.616741:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863590.616753:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863590.616762:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d400, rc 0) 00000100:00100000:3.0:1788863590.619685:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226489856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3011us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.619697:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788863590.621199:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863590.621239:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.621260:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863590.621363:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863590.621421:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.621469:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860180 going to sleep for 11 seconds 00000100:00100000:1.0:1788863590.622003:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226489984 00000100:00100000:1.0:1788863590.622011:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226489984 00000100:00100000:1.0:1788863590.622058:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788863590.622067:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226489984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.622296:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226489984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.622370:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788863590.622495:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226489984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.622535:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226490112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.622636:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.622671:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863590.622891:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226490112 00000100:00100000:3.0:1788863590.622898:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226490112 00000100:00100000:3.0:1788863590.622937:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788863590.622946:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226490112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863590.623760:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226490112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 813us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.623770:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788863590.636209:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226490112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863590.636511:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10468:1875759226490240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863590.636581:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.636622:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226490240 00000100:00100000:2.0:1788863590.636628:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226490240 00000100:00100000:2.0:1788863590.636670:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788863590.636681:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:10468:x1875759226490240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863590.636793:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:10468:x1875759226490240:12345-0@lo:502:llog_process_th.0 Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.636812:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788863590.636867:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860840 going to sleep for 11 seconds 00000100:00100000:2.0:1788863590.636882:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10468:1875759226490240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863590.636904:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863590.636913:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863590.636916:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788863590.636923:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e64a89a800 00000020:00000080:2.0:1788863590.636925:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788863590.637287:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10468:1875759226490368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863590.637331:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.637353:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542860840 going to sleep for 11 seconds 00000100:00100000:3.0:1788863590.638106:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226490368 00000100:00100000:3.0:1788863590.638115:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226490368 00000100:00100000:3.0:1788863590.638154:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788863590.638162:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:10468:x1875759226490368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863590.638275:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:10468:x1875759226490368:12345-0@lo:502:llog_process_th.0 Request processed in 113us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.638292:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788863590.639198:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:10468:1875759226490368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863590.639441:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863590.639450:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863590.639452:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788863590.639456:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788863590.639530:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788863590.639551:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863590.639561:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863590.639573:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863590.895257:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863590.897435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863590.897472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863590.897497:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863590.897563:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863590.897599:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456768 00000100:00100000:1.0:1788863590.897609:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456768 00000100:00100000:1.0:1788863590.897682:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456896 00000100:00100000:1.0:1788863590.897686:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456896 00000100:00100000:1.0:1788863590.897713:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1788863590.897723:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205456768:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863590.897847:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205456768:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 125us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.897856:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1788863590.897876:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:1.0:1788863590.897883:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205456896:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863590.897909:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205456896:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.897915:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00080000:1.0:1788863590.897937:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863590.897942:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863590.898870:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456512 00000100:00100000:3.0:1788863590.898879:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456512 00000100:00100000:3.0:1788863590.898935:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456640 00000100:00100000:3.0:1788863590.898939:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456640 00000100:00100000:3.0:1788863590.898963:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788863590.898971:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205456512:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863590.899022:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205456512:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 51us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.899029:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788863590.899045:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:3.0:1788863590.899052:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205456640:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863590.899106:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205456640:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.899113:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00080000:1.0:1788863590.901309:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863590.901317:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863590.902227:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205456384 00000100:00100000:2.0:1788863590.902240:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205456384 00000100:00100000:2.0:1788863590.902339:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 269 00000100:00100000:2.0:1788863590.902350:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:2410:x1875759205456384:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863590.902425:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+9:2410:x1875759205456384:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 78us (7179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.902433:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 269 00000100:00100000:3.0:1788863590.956560:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863590.956642:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457024 00000100:00100000:0.0:1788863590.956653:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457024 00000100:00100000:0.0:1788863590.956714:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 270 00000100:00100000:0.0:1788863590.956724:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+9:6188:x1875759205457024:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863590.956743:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863590.956766:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187dc3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.956807:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.956819:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863590.956847:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90e00, rc 0) 00000100:00100000:0.0:1788863590.956904:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205457024:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 181us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.956912:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 270 00000100:00100000:1.0:1788863590.960506:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863590.960573:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457152 00000100:00100000:3.0:1788863590.960583:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457152 00000100:00100000:3.0:1788863590.960635:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 271 00000100:00100000:3.0:1788863590.960644:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205457152:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863590.960807:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205457152:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 163us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.960815:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 271 00000100:00100000:0.0:1788863590.964688:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863590.964764:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457280 00000100:00100000:1.0:1788863590.964775:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457280 00000100:00100000:1.0:1788863590.964844:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 272 00000100:00100000:1.0:1788863590.964854:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205457280:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863590.965016:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:6188:x1875759205457280:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 162us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.965024:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 272 00000100:00100000:1.0:1788863590.991443:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863590.991601:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457408 00000100:00100000:0.0:1788863590.991613:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457408 00000100:00100000:0.0:1788863590.991674:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 273 00000100:00100000:0.0:1788863590.991685:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:6729:x1875759205457408:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863590.991864:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:6729:x1875759205457408:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 180us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.991872:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 273 00000100:00100000:1.0:1788863590.997688:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863590.997810:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457536 00000100:00100000:0.0:1788863590.997821:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457536 00000100:00100000:0.0:1788863590.997886:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 274 00000100:00100000:0.0:1788863590.997895:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6729:x1875759205457536:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863590.998057:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:6729:x1875759205457536:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 162us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.998065:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 274 00000100:00100000:3.0:1788863591.405400:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226490496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863591.405502:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863591.405592:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226490496 00000100:00100000:3.0:1788863591.405601:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226490496 00000100:00100000:3.0:1788863591.405664:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863591.405674:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226490496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863591.405715:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863591.405761:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226490496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863591.405768:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788863591.405830:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f1500 x1875759226490496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863591.405854:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226490496:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788863591.407249:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863591.408425:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226490624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863591.408584:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863591.409045:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226490624 00000100:00100000:3.0:1788863591.409055:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226490624 00000100:00100000:3.0:1788863591.409139:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863591.409151:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226490624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863591.409177:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788863591.409262:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863591.424666:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226490624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15504us (16070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863591.424683:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788863591.434230:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438c1180 x1875759226490624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863591.434289:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226490624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863591.596637:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863591.916894:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226491008:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.916966:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863591.917029:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226491520:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.917055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863591.917095:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226492032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.917127:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863591.917151:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788863591.917157:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226490880:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.917178:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863591.917196:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226491392:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.917216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917336:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226490752:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917401:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226491264:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917439:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226491776:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917479:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226492288:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917517:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788863591.917524:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226491136:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917555:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226491648:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917574:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917592:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226492160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917610:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863591.917639:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226490752 00000100:00100000:0.0:1788863591.917647:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226490752 00000100:00100000:0.0:1788863591.917695:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788863591.917705:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226490752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917761:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226490752:12345-0@lo:400:kworker.0 Request processed in 57us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863591.917768:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788863591.917820:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491776 00000100:00100000:0.0:1788863591.917824:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491776 00000100:00100000:0.0:1788863591.917841:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492288 00000100:00100000:0.0:1788863591.917844:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492288 00000100:00100000:0.0:1788863591.917863:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491648 00000100:00100000:0.0:1788863591.917865:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491648 00000100:00100000:0.0:1788863591.917875:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492160 00000100:00100000:0.0:1788863591.917878:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492160 00000100:00100000:0.0:1788863591.917891:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863591.917896:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226491776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917929:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226491776:12345-0@lo:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863591.917935:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863591.917946:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863591.917952:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226492288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.917978:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226492288:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863591.917984:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863591.917995:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863591.918001:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226491648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.918026:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226491648:12345-0@lo:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863591.918032:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863591.918044:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863591.918050:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226492160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.918096:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226492160:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863591.918112:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788863591.918161:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543409180 x1875759226491648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863591.918176:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226491648:0@lo:400:kworker.0 00010000:00080000:0.0:1788863591.918186:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67aed5c00 x1875759226492160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863591.918193:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226492160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.918199:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226490752:0@lo:400:kworker.0 00010000:00080000:0.0:1788863591.918208:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67aed4700 x1875759226491776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863591.918215:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226491776:0@lo:400:kworker.0 00010000:00080000:0.0:1788863591.918222:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67aed6300 x1875759226492288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863591.918458:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491008 00000100:00100000:2.0:1788863591.918462:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491008 00000100:00100000:2.0:1788863591.918489:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491264 00000100:00100000:2.0:1788863591.918492:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491264 00000100:00100000:2.0:1788863591.918506:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788863591.918512:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226491008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863591.918557:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226491008:12345-0@lo:400:kworker.0 Request processed in 45us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863591.918563:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788863591.918583:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788863591.918589:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226491264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863591.918615:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226491264:12345-0@lo:400:kworker.0 Request processed in 27us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863591.918621:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788863591.918810:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491520 00000100:00100000:2.0:1788863591.918815:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491520 00000100:00100000:2.0:1788863591.918837:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492032 00000100:00100000:2.0:1788863591.918839:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492032 00000100:00100000:2.0:1788863591.918852:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226490880 00000100:00100000:2.0:1788863591.918854:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226490880 00000100:00100000:2.0:1788863591.918865:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491392 00000100:00100000:2.0:1788863591.918867:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491392 00000100:00100000:2.0:1788863591.918913:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491136 00000100:00100000:2.0:1788863591.918917:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491136 00000100:00100000:2.0:1788863591.918934:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788863591.918940:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226491520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863591.918971:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226491520:12345-0@lo:400:kworker.0 Request processed in 32us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863591.918978:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788863591.918990:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863591.918996:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226492032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863591.919043:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226492032:12345-0@lo:400:kworker.0 Request processed in 47us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863591.919049:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863591.919067:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863591.919073:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226490880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863591.919123:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226490880:12345-0@lo:400:kworker.0 Request processed in 51us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863591.919129:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863591.919139:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788863591.919145:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226491136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863591.919167:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226491136:12345-0@lo:400:kworker.0 Request processed in 23us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863591.919172:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788863591.919201:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788863591.919207:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226491392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.919335:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226492288:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.919380:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226491136:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.919391:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226491264:0@lo:400:kworker.0 00000100:00100000:2.0:1788863591.919489:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226491392:12345-0@lo:400:kworker.0 Request processed in 281us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863591.919496:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788863591.919646:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863591.919651:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863591.919661:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863591.919870:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226491392:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.919882:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226491904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.919913:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863591.919936:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226491008:0@lo:400:kworker.0 00010000:00080000:3.0:1788863591.919950:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340a300 x1875759226491520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863591.919959:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226491520:0@lo:400:kworker.0 00010000:00080000:3.0:1788863591.919970:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67aed4e00 x1875759226492032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863591.919978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226492032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863591.920001:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226490880:0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.922869:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226491904 00000100:00100000:0.0:1788863591.922888:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226491904 00000100:00100000:0.0:1788863591.922995:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788863591.923007:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226491904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863591.923154:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226491904:12345-0@lo:400:kworker.0 Request processed in 150us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863591.923177:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788863591.923280:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863591.923490:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226491904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863592.427403:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863592.427426:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226492416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863592.427495:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863592.427873:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492416 00000100:00100000:2.0:1788863592.427880:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492416 00000100:00100000:2.0:1788863592.427943:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863592.427953:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226492416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863592.427983:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863592.428028:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226492416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863592.428034:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863592.428255:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863592.428267:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226492544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863592.428301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788863592.428469:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67aed7b80 x1875759226492416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863592.428503:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226492416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863592.428570:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492544 00000100:00100000:2.0:1788863592.428575:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492544 00000100:00100000:2.0:1788863592.428605:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863592.428619:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226492544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863592.428632:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863592.428710:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226492544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863592.428716:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788863592.431318:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f0000 x1875759226492544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863592.431347:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226492544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863592.626469:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863592.939440:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863592.939474:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226492672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863592.939571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863592.939819:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492672 00000100:00100000:2.0:1788863592.939830:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492672 00000100:00100000:2.0:1788863592.939896:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788863592.939907:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226492672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863592.939952:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863592.940120:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226492672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 213us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863592.940128:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788863592.941911:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863592.941940:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226492800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863592.942024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863592.942284:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492800 00000100:00100000:2.0:1788863592.942295:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492800 00000100:00100000:2.0:1788863592.942358:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788863592.942369:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226492800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863592.942411:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863592.942466:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226492800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863592.942474:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788863592.942574:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226492800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863592.947277:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226492672:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788863593.645488:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863594.669371:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863595.691374:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863596.011649:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863596.011708:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863596.011753:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863596.011783:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457920 00000100:00100000:3.0:1788863596.011795:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457920 00000100:00100000:3.0:1788863596.011870:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:3.0:1788863596.011880:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205457920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863596.011958:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205457920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863596.011965:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:3.0:1788863596.011990:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458176 00000100:00100000:3.0:1788863596.011994:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458176 00000100:00100000:3.0:1788863596.012020:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:3.0:1788863596.012026:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205458176:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863596.012063:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205458176:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863596.012101:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:1.0:1788863596.012231:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457664 00000100:00100000:1.0:1788863596.012236:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457664 00000100:00100000:1.0:1788863596.012268:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 276 00000100:00100000:1.0:1788863596.012275:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2411:x1875759205457664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863596.012303:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2411:x1875759205457664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863596.012311:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 276 00000100:00080000:1.0:1788863596.012342:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863596.012347:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863596.020188:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863596.020220:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863596.020244:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205457792 00000100:00100000:3.0:1788863596.020252:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205457792 00000100:00100000:3.0:1788863596.020309:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:3.0:1788863596.020319:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205457792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863596.020396:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205457792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863596.020405:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:3.0:1788863596.020430:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458048 00000100:00100000:3.0:1788863596.020433:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458048 00000100:00100000:3.0:1788863596.020459:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:3.0:1788863596.020465:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205458048:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863596.020490:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205458048:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863596.020496:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00080000:3.0:1788863596.020511:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863596.020516:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788863596.074883:0:10714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788863596.523388:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863596.523413:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226492928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863596.523483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863596.527247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226493056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863596.527332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863596.527544:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226492928 00000100:00100000:2.0:1788863596.527555:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226492928 00000100:00100000:2.0:1788863596.527609:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493056 00000100:00100000:2.0:1788863596.527612:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493056 00000100:00100000:2.0:1788863596.527630:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788863596.527639:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226492928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863596.527711:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863596.527758:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226492928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863596.527765:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788863596.527784:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863596.527790:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226493056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863596.527799:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863596.527822:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226493056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863596.527828:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788863596.533125:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863596.533302:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf2d80 x1875759226493056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863596.533332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226493056:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788863596.533347:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf0380 x1875759226492928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863596.533360:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226492928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863596.717840:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863597.039335:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226493184:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.040233:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226493440:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.040301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.040363:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226493952:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.040389:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.040408:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226494464:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.040440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.040469:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863597.040477:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226493568:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.040499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.040526:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226494080:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.040548:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863597.041183:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493952 00000100:00100000:0.0:1788863597.041192:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493952 00000100:00100000:0.0:1788863597.041246:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494464 00000100:00100000:0.0:1788863597.041250:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494464 00000100:00100000:0.0:1788863597.041265:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493568 00000100:00100000:0.0:1788863597.041267:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493568 00000100:00100000:0.0:1788863597.041282:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863597.041290:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226493952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863597.041353:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226493952:12345-0@lo:400:kworker.0 Request processed in 63us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.041481:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226494592:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788863597.041550:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf1f80 x1875759226493952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863597.041580:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226493952:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041609:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226493312:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.041664:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226493824:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041698:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.041710:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041733:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.041778:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493440 00000100:00100000:3.0:1788863597.041783:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493440 00000100:00100000:3.0:1788863597.041821:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788863597.041830:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226493440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041878:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226493440:12345-0@lo:400:kworker.0 Request processed in 49us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.041886:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788863597.041892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.041926:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493312 00000100:00100000:3.0:1788863597.041930:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493312 00000100:00100000:1.0:1788863597.041934:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226493696:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041949:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493824 00000100:00100000:3.0:1788863597.041953:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493824 00000100:00100000:1.0:1788863597.041965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863597.041971:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494336 00000100:00100000:3.0:1788863597.041975:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494336 00000100:00100000:1.0:1788863597.041990:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226494208:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.041996:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788863597.042007:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226494464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863597.042017:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863597.042050:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226494720:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.042053:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226494464:12345-0@lo:400:kworker.0 Request processed in 48us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042061:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788863597.042107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863597.042149:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493184 00000100:00100000:1.0:1788863597.042153:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493184 00000100:00100000:1.0:1788863597.042178:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788863597.042185:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226493184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863597.042221:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226493184:12345-0@lo:400:kworker.0 Request processed in 36us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863597.042227:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788863597.042253:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226493696 00000100:00100000:1.0:1788863597.042257:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226493696 00000100:00100000:1.0:1788863597.042279:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788863597.042281:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788863597.042288:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226493696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.042299:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226493568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863597.042341:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226493696:12345-0@lo:400:kworker.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042350:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226493568:12345-0@lo:400:kworker.0 Request processed in 55us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863597.042351:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788863597.042362:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788863597.042376:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788863597.042382:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226493312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.042413:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226493312:12345-0@lo:400:kworker.0 Request processed in 31us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042419:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788863597.042430:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863597.042436:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226493824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863597.042501:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863597.042516:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788863597.042522:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226494336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863597.042555:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226494336:12345-0@lo:400:kworker.0 Request processed in 33us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863597.042561:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788863597.042579:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863597.042583:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863597.042618:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226493824:12345-0@lo:400:kworker.0 Request processed in 181us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042627:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863597.042654:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494080 00000100:00100000:3.0:1788863597.042666:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494080 00000100:00100000:3.0:1788863597.042698:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494592 00000100:00100000:3.0:1788863597.042701:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494592 00000100:00100000:3.0:1788863597.042729:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494208 00000100:00100000:3.0:1788863597.042732:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494208 00000100:00100000:3.0:1788863597.042745:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494720 00000100:00100000:3.0:1788863597.042748:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494720 00000100:00100000:3.0:1788863597.042765:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788863597.042771:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226494080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.042807:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226494080:12345-0@lo:400:kworker.0 Request processed in 36us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042813:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788863597.042824:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788863597.042829:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226494592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.042854:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226494592:12345-0@lo:400:kworker.0 Request processed in 25us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042859:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788863597.042869:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863597.042876:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226494208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.042902:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226494208:12345-0@lo:400:kworker.0 Request processed in 28us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042907:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863597.042916:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863597.042923:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226494720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.042950:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226494720:12345-0@lo:400:kworker.0 Request processed in 28us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863597.042955:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863597.043011:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226493312:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.043023:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226493824:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.043032:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.043064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226493568:0@lo:400:kworker.0 00010000:00080000:3.0:1788863597.043492:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf0700 x1875759226494080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863597.043504:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226494080:0@lo:400:kworker.0 00010000:00080000:3.0:1788863597.043524:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf2300 x1875759226494592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863597.043533:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226494592:0@lo:400:kworker.0 00000100:00100000:3.0:1788863597.043546:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226493440:0@lo:400:kworker.0 00000100:00080000:0.0:1788863597.043549:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788863597.043721:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf1c00 x1875759226494464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863597.043735:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226494464:0@lo:400:kworker.0 00000100:00100000:1.0:1788863597.045807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226493184:0@lo:400:kworker.0 00000100:00100000:1.0:1788863597.045832:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226493696:0@lo:400:kworker.0 00010000:00080000:1.0:1788863597.045849:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf3b80 x1875759226494208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863597.045861:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226494208:0@lo:400:kworker.0 00010000:00080000:1.0:1788863597.045873:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf1880 x1875759226494720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863597.045883:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226494720:0@lo:400:kworker.0 00000100:00100000:1.0:1788863597.547659:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226494848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863597.547742:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863597.547796:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494848 00000100:00100000:2.0:1788863597.547805:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494848 00000100:00100000:2.0:1788863597.547870:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863597.547883:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226494848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863597.547899:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226494976:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863597.547915:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863597.547931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863597.547972:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226494848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863597.547979:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788863597.548001:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226494976 00000100:00100000:1.0:1788863597.548007:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226494976 00000100:00100000:1.0:1788863597.548047:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863597.548773:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226494976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863597.548791:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863597.548846:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226494976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 792us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863597.548854:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788863597.548904:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f2680 x1875759226494848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788863597.548905:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01f80 x1875759226494976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863597.548944:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226494848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863597.548945:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226494976:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863597.740450:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863598.060648:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863598.060694:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226495104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863598.060816:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863598.061278:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226495104 00000100:00100000:2.0:1788863598.061292:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226495104 00000100:00100000:2.0:1788863598.061371:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788863598.061383:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226495104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863598.061461:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863598.061539:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226495104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863598.061559:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788863598.061764:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226495104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863598.062814:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226495232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863598.062901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863598.065601:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226495232 00000100:00100000:3.0:1788863598.065625:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226495232 00000100:00100000:3.0:1788863598.065726:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788863598.065739:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226495232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863598.065811:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788863598.090280:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226495232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 24525us (27360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863598.090303:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788863598.097214:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226495232:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788863598.764370:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863599.787277:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863600.811242:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863601.148503:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863601.148558:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863601.148585:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863601.148624:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863601.148663:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863601.148697:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458560 00000100:00100000:1.0:1788863601.148729:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458560 00000100:00100000:1.0:1788863601.148809:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458432 00000100:00100000:1.0:1788863601.148813:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458432 00000100:00100000:1.0:1788863601.148844:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:1.0:1788863601.148857:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205458560:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863601.148961:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205458560:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 106us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863601.148970:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:1.0:1788863601.148996:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:1.0:1788863601.149003:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205458432:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863601.149044:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205458432:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 41us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863601.149051:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:1.0:1788863601.149104:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458688 00000100:00100000:1.0:1788863601.149109:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458688 00000100:00100000:1.0:1788863601.149136:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458816 00000100:00100000:1.0:1788863601.149139:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458816 00000100:00100000:1.0:1788863601.149159:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:1.0:1788863601.149166:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2407:x1875759205458688:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:1.0:1788863601.149199:0:8450:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68d1c 00000100:00080000:1.0:1788863601.149211:0:8450:0:(import.c:65:import_set_state_nolock()) ffff89e543a40800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788863601.149267:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788863601.149427:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+2:2407:x1875759205458688:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 261us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863601.149434:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:1.0:1788863601.149447:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:1.0:1788863601.149453:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2407:x1875759205458816:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:1.0:1788863601.149475:0:8450:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68d23 00000100:00080000:1.0:1788863601.149483:0:8450:0:(import.c:65:import_set_state_nolock()) ffff89e681a7a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788863601.149507:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788863601.149587:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+2:2407:x1875759205458816:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 133us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863601.149606:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00080000:1.0:1788863601.149631:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863601.149636:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863601.149638:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863601.149640:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788863601.149880:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863601.149888:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863601.150135:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458304 00000100:00100000:2.0:1788863601.150144:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458304 00000100:00100000:2.0:1788863601.150189:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 278 00000100:00100000:2.0:1788863601.150197:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:2408:x1875759205458304:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863601.150242:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:2408:x1875759205458304:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863601.150249:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 278 00000100:00100000:1.0:1788863601.646934:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863601.646966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226495488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863601.647205:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863601.647217:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226495360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863601.647285:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863601.647370:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226495360 00000100:00100000:3.0:1788863601.647381:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226495360 00000100:00100000:3.0:1788863601.647452:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863601.647481:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226495360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863601.647520:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863601.647575:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226495360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863601.647592:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788863601.647616:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863601.647656:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf2300 x1875759226495360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863601.647679:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226495360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863601.647962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863601.648114:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226495488 00000100:00100000:0.0:1788863601.648120:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226495488 00000100:00100000:0.0:1788863601.648157:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863601.648164:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226495488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863601.648182:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863601.648221:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226495488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863601.648227:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788863601.648244:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863601.648268:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf0700 x1875759226495488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863601.648283:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226495488:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788863601.840427:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863602.156513:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226496000:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.156639:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863602.156725:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226496512:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.156765:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863602.156792:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226497024:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.156814:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863602.156854:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788863602.156861:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226495616:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.156895:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863602.156917:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226496128:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157159:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496000 00000100:00100000:3.0:1788863602.157180:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496000 00000100:00100000:3.0:1788863602.157259:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863602.157271:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226496000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157343:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226496000:12345-0@lo:400:kworker.0 Request processed in 75us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863602.157351:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863602.157389:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226495872:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863602.157455:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226496384:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157475:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863602.157489:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226496896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157507:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863602.157524:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788863602.157531:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226495744:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157549:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863602.157565:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226496256:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157595:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863602.157605:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226496768:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157622:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863602.157642:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496384 00000100:00100000:3.0:1788863602.157646:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496384 00000100:00100000:3.0:1788863602.157672:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496896 00000100:00100000:3.0:1788863602.157675:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496896 00000100:00100000:3.0:1788863602.157686:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226495744 00000100:00100000:3.0:1788863602.157688:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226495744 00000100:00100000:3.0:1788863602.157701:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496256 00000100:00100000:3.0:1788863602.157703:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496256 00000100:00100000:3.0:1788863602.157713:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496768 00000100:00100000:3.0:1788863602.157716:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496768 00000100:00100000:3.0:1788863602.157729:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863602.157734:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226496384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157763:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226496384:12345-0@lo:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863602.157778:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863602.157790:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788863602.157795:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226496896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157818:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226496896:12345-0@lo:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863602.157824:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788863602.157832:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788863602.157836:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226495744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157855:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226495744:12345-0@lo:400:kworker.0 Request processed in 19us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863602.157860:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788863602.157869:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788863602.157873:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226496256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157892:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226496256:12345-0@lo:400:kworker.0 Request processed in 19us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863602.157897:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788863602.157906:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788863602.157911:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226496768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.157930:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226496768:12345-0@lo:400:kworker.0 Request processed in 19us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863602.157935:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788863602.157951:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863602.157956:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863602.157990:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226495744:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.158009:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226496256:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.158016:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226496768:0@lo:400:kworker.0 00010000:00080000:3.0:1788863602.158028:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf0700 x1875759226496384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863602.158039:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226496384:0@lo:400:kworker.0 00010000:00080000:3.0:1788863602.158048:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ea00 x1875759226496896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863602.158056:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226496896:0@lo:400:kworker.0 00000100:00100000:2.0:1788863602.159508:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226495616 00000100:00100000:2.0:1788863602.159528:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226495616 00000100:00100000:2.0:1788863602.159613:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788863602.159624:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226495616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863602.159728:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226495616:12345-0@lo:400:kworker.0 Request processed in 105us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863602.159736:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788863602.159786:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496512 00000100:00100000:2.0:1788863602.159794:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496512 00000100:00100000:2.0:1788863602.159833:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497024 00000100:00100000:2.0:1788863602.159836:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497024 00000100:00100000:2.0:1788863602.163853:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863602.163888:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226496512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863602.164037:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226496512:12345-0@lo:400:kworker.0 Request processed in 167us (7271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863602.164068:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863602.164318:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863602.164327:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226497024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863602.164364:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226497024:12345-0@lo:400:kworker.0 Request processed in 39us (7549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863602.164370:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788863602.164813:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863602.168050:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226495872 00000100:00100000:0.0:1788863602.168072:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226495872 00000100:00100000:0.0:1788863602.168344:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788863602.168356:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226495872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863602.168512:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226495872:12345-0@lo:400:kworker.0 Request processed in 159us (11089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863602.168527:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788863602.168754:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226495872:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.168837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863602.169336:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226496640:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.169376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863602.169422:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496640 00000100:00100000:1.0:1788863602.169430:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496640 00000100:00100000:1.0:1788863602.169473:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863602.169481:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226496640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.169531:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226496640:12345-0@lo:400:kworker.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863602.169537:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788863602.169596:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0e300 x1875759226496640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863602.169610:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226496640:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.169619:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226497152:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.169644:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863602.169684:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226496000:0@lo:400:kworker.0 00010000:00080000:1.0:1788863602.169702:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf2300 x1875759226496512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863602.169711:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226496512:0@lo:400:kworker.0 00010000:00080000:1.0:1788863602.169724:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f800 x1875759226497024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863602.169733:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226497024:0@lo:400:kworker.0 00000100:00100000:1.0:1788863602.169764:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226495616:0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.170068:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497152 00000100:00100000:3.0:1788863602.170619:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497152 00000100:00100000:3.0:1788863602.170689:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788863602.170699:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226497152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863602.170783:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226497152:12345-0@lo:400:kworker.0 Request processed in 86us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863602.170789:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788863602.170819:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863602.174249:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226496128 00000100:00100000:0.0:1788863602.174268:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226496128 00000100:00100000:0.0:1788863602.174345:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788863602.174358:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226496128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863602.174492:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226496128:12345-0@lo:400:kworker.0 Request processed in 137us (5656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863602.174500:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788863602.176016:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226496128:0@lo:400:kworker.0 00010000:00080000:1.0:1788863602.176056:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ca80 x1875759226497152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863602.176069:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226497152:0@lo:400:kworker.0 00000001:02000400:3.0:1788863602.398294:0:10958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing yml_node 00000100:00100000:3.0:1788863602.667650:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226497280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863602.667762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863602.667932:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863602.667942:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226497408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863602.667969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863602.668001:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497280 00000100:00100000:2.0:1788863602.668011:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497280 00000100:00100000:2.0:1788863602.668059:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497408 00000100:00100000:2.0:1788863602.668061:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497408 00000100:00100000:2.0:1788863602.668095:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788863602.668105:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226497280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863602.668143:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863602.668192:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226497280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863602.668199:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788863602.668220:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788863602.668225:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226497408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863602.668235:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863602.668256:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226497408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863602.668261:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788863602.668298:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f3b80 x1875759226497408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863602.668331:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226497408:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788863602.668346:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01180 x1875759226497280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863602.668356:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226497280:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788863602.859832:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863603.179580:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226497536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863603.179690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863603.180029:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497536 00000100:00100000:0.0:1788863603.180051:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497536 00000100:00100000:0.0:1788863603.180143:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788863603.180157:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226497536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863603.180221:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788863603.180299:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226497536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863603.180307:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788863603.180589:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226497536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863603.181851:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226497664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863603.181933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863603.182064:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497664 00000100:00100000:2.0:1788863603.182363:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497664 00000100:00100000:2.0:1788863603.182490:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788863603.182502:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226497664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863603.182560:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863603.182628:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226497664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863603.182635:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788863603.184016:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226497664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788863603.885516:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863604.910008:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863605.932003:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863606.256964:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863606.260036:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863606.260201:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863606.260356:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205458944 00000100:00100000:0.0:1788863606.260370:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205458944 00000100:00100000:0.0:1788863606.260447:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 280 00000100:00100000:0.0:1788863606.260459:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205458944:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863606.260653:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205458944:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 194us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863606.260662:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 280 00000100:00100000:2.0:1788863606.268911:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459200 00000100:00100000:2.0:1788863606.268934:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459200 00000100:00080000:3.0:1788863606.269051:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863606.269283:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459072 00000100:00100000:0.0:1788863606.269290:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459072 00000100:00100000:0.0:1788863606.269345:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 94 00000100:00100000:0.0:1788863606.269357:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205459200:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:3.0:1788863606.269457:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863606.269592:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205459200:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 237us (9568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863606.269602:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 94 00000100:00100000:0.0:1788863606.269624:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:0.0:1788863606.269630:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205459072:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863606.269657:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205459072:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (9458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863606.269664:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:1.0:1788863606.764303:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226497792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863606.764389:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863606.764490:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497792 00000100:00100000:1.0:1788863606.764498:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497792 00000100:00100000:1.0:1788863606.764548:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788863606.764557:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226497792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863606.764584:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863606.764627:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226497792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863606.764635:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788863606.764656:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863606.765031:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f800 x1875759226497792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863606.765050:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226497792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863606.769061:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226497920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863606.769155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863606.770812:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226497920 00000100:00100000:0.0:1788863606.770824:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226497920 00000100:00100000:0.0:1788863606.770891:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863606.770910:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226497920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863606.770936:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863606.771000:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226497920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863606.771008:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788863606.771211:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01180 x1875759226497920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863606.771233:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226497920:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788863606.771288:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:1.0:1788863606.771293:0:8444:0:(genops.c:885:class_export_put()) final put ffff89e543a41000/7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000100:00080000:3.0:1788863606.771632:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788863606.771678:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543a41000/7a6822fa-e36f-4316-b7e3-4bba6134cbda for lustre-OST0000 00000020:00000080:0.0:1788863606.771719:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543a40800 for lustre-OST0000 00000001:00100000:1.0:1788863606.772305:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:1.0:1788863606.772309:0:9530:0:(genops.c:885:class_export_put()) final put ffff89e67ad5b800/7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:0.0:1788863606.772539:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67ad5b800/7a6822fa-e36f-4316-b7e3-4bba6134cbda for lustre-OST0001 00000020:00000080:0.0:1788863606.772577:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e681a7a000 for lustre-OST0001 00000001:02000400:3.0:1788863606.891757:0:11141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1788863606.957808:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863607.276737:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226498304:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.276809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863607.276867:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226498816:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.276893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863607.276912:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226499328:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.276934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863607.276959:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788863607.276965:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226498432:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.276987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863607.277005:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226498944:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.277027:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863607.277052:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226499456:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.277072:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863607.277129:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498304 00000100:00100000:0.0:1788863607.277136:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498304 00000100:00100000:0.0:1788863607.277181:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788863607.277190:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226498304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.277244:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226498304:12345-0@lo:400:kworker.0 Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863607.277251:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788863607.277273:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498816 00000100:00100000:0.0:1788863607.277277:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498816 00000100:00100000:0.0:1788863607.277308:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499328 00000100:00100000:0.0:1788863607.277311:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499328 00000100:00100000:0.0:1788863607.277336:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498432 00000100:00100000:0.0:1788863607.277339:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498432 00000100:00100000:0.0:1788863607.277352:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788863607.277358:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226498816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277496:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226498048:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277531:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863607.277559:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226498560:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277583:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863607.277600:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226499072:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863607.277639:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226499584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863607.277676:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863607.277682:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226498176:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863607.277716:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226498688:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277734:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863607.277744:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226499200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277762:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863607.277783:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498048 00000100:00100000:3.0:1788863607.277786:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498048 00000100:00100000:3.0:1788863607.277815:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788863607.277822:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226498048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277856:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226498048:12345-0@lo:400:kworker.0 Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863607.277870:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788863607.277900:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498560 00000100:00100000:3.0:1788863607.277904:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498560 00000100:00100000:3.0:1788863607.277927:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788863607.277934:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226498560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.277967:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226498560:12345-0@lo:400:kworker.0 Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863607.277974:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788863607.277991:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498944 00000100:00100000:3.0:1788863607.277995:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498944 00000100:00100000:3.0:1788863607.278011:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499456 00000100:00100000:3.0:1788863607.278013:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499456 00000100:00100000:3.0:1788863607.278026:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499072 00000100:00100000:3.0:1788863607.278028:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499072 00000100:00100000:3.0:1788863607.278039:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499584 00000100:00100000:3.0:1788863607.278041:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499584 00000100:00100000:3.0:1788863607.278054:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788863607.278061:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226498944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.278119:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226498944:12345-0@lo:400:kworker.0 Request processed in 58us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863607.278126:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788863607.278138:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863607.278144:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226499456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.278171:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226499456:12345-0@lo:400:kworker.0 Request processed in 28us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863607.278176:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863607.278187:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863607.278202:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226499072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.278235:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226499072:12345-0@lo:400:kworker.0 Request processed in 35us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863607.278241:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863607.278253:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863607.278260:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226499584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.278286:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226499584:12345-0@lo:400:kworker.0 Request processed in 27us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863607.278293:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863607.278329:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226498048:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.278341:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226498560:0@lo:400:kworker.0 00010000:00080000:3.0:1788863607.278352:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676154380 x1875759226499072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863607.278378:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226499072:0@lo:400:kworker.0 00010000:00080000:3.0:1788863607.278389:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340bb80 x1875759226499584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863607.278395:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226499584:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.278835:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226498816:12345-0@lo:400:kworker.0 Request processed in 1477us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863607.278842:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788863607.278859:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498176 00000100:00100000:0.0:1788863607.278863:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498176 00000100:00100000:0.0:1788863607.278880:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226498688 00000100:00100000:0.0:1788863607.278884:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226498688 00000100:00100000:0.0:1788863607.278897:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499200 00000100:00100000:0.0:1788863607.278900:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499200 00000100:00100000:0.0:1788863607.278913:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788863607.278919:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226499328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.278949:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226499328:12345-0@lo:400:kworker.0 Request processed in 30us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863607.278955:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788863607.278967:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788863607.278973:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226498432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.279002:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226498432:12345-0@lo:400:kworker.0 Request processed in 29us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863607.279007:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788863607.279019:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788863607.279025:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226498176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863607.279200:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788863607.279210:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226498688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863607.279258:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226498688:12345-0@lo:400:kworker.0 Request processed in 51us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863607.279264:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788863607.279278:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788863607.279285:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226499200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863607.279312:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226499200:12345-0@lo:400:kworker.0 Request processed in 29us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863607.279318:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788863607.279355:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226498432:0@lo:400:kworker.0 00010000:00080000:1.0:1788863607.279384:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676157800 x1875759226498944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863607.279394:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226498944:0@lo:400:kworker.0 00010000:00080000:1.0:1788863607.279405:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340a680 x1875759226499456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863607.279431:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226499456:0@lo:400:kworker.0 00000100:00100000:1.0:1788863607.279444:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226498304:0@lo:400:kworker.0 00010000:00080000:1.0:1788863607.279454:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676157100 x1875759226498816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863607.279461:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226498816:0@lo:400:kworker.0 00010000:00080000:1.0:1788863607.279482:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676156300 x1875759226499328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863607.279491:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226499328:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.279648:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226498688:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.279658:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226499200:0@lo:400:kworker.0 00000100:00100000:0.0:1788863607.280535:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226498176:12345-0@lo:400:kworker.0 Request processed in 1506us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863607.280554:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788863607.280586:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863607.280592:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863607.280595:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863607.280729:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226498176:0@lo:400:kworker.0 00000100:00100000:3.0:1788863607.789716:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226499712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863607.789812:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863607.790533:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499712 00000100:00100000:1.0:1788863607.790547:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499712 00000100:00100000:1.0:1788863607.790632:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788863607.790643:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226499712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863607.790688:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863607.790754:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226499712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863607.790761:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788863607.791800:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d180 x1875759226499712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863607.791828:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226499712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863607.797769:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226499840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863607.797871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863607.799292:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499840 00000100:00100000:0.0:1788863607.799310:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499840 00000100:00100000:0.0:1788863607.799401:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863607.799414:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226499840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863607.799452:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863607.799551:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226499840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863607.799559:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788863607.799771:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438df100 x1875759226499840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863607.799798:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226499840:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863607.979245:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863608.303851:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226499968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863608.303954:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863608.304835:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226499968 00000100:00100000:2.0:1788863608.304845:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226499968 00000100:00100000:2.0:1788863608.304913:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788863608.304923:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226499968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863608.304961:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863608.305033:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226499968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863608.305041:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863608.305560:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226499968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863608.310721:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226500096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863608.310798:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863608.310914:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500096 00000100:00100000:3.0:1788863608.310922:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500096 00000100:00100000:3.0:1788863608.310973:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788863608.310982:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226500096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863608.311016:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788863608.311063:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226500096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863608.311070:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788863608.311181:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226500096:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788863609.009614:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788863609.729896:0:11239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1788863610.027478:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863611.052226:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863611.377275:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863611.377495:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863611.377531:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863611.377604:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459584 00000100:00100000:1.0:1788863611.377615:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459584 00000100:00100000:1.0:1788863611.377678:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459456 00000100:00100000:1.0:1788863611.377681:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459456 00000100:00100000:1.0:1788863611.377705:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 102 00000100:00100000:1.0:1788863611.377715:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205459584:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863611.377797:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205459584:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863611.377805:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 102 00000100:00100000:1.0:1788863611.377839:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 103 00000100:00100000:1.0:1788863611.377846:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205459456:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863611.377871:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205459456:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863611.377877:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 103 00000100:00080000:0.0:1788863611.378016:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863611.378021:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863611.384834:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459328 00000100:00100000:3.0:1788863611.384850:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459328 00000100:00100000:3.0:1788863611.384923:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 282 00000100:00100000:3.0:1788863611.384933:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205459328:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863611.385027:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205459328:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 95us (7761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863611.385036:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 282 00000100:00100000:1.0:1788863611.883495:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863611.883521:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226500224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863611.884003:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863611.884137:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863611.884148:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226500352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863611.884891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863611.890932:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500224 00000100:00100000:3.0:1788863611.890949:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500224 00000100:00100000:3.0:1788863611.891044:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500352 00000100:00100000:3.0:1788863611.891048:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500352 00000100:00100000:2.0:1788863611.891105:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788863611.891145:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226500224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863611.891181:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863611.891278:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226500224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (7275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863611.891286:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788863611.891407:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0df80 x1875759226500224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863611.891429:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226500224:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788863611.894808:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863611.897934:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863611.897947:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226500352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863611.897976:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863611.898064:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226500352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (13173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863611.898101:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788863611.898252:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681e2e300 x1875759226500352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863611.898273:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226500352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863612.077136:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863612.397220:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226500608:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.397481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863612.397539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226501120:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.397574:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863612.397600:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226501632:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.397624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863612.397649:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788863612.397752:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226500736:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.397781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863612.397811:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226501248:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.397832:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863612.397850:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226501760:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.397885:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863612.397924:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500608 00000100:00100000:1.0:1788863612.397931:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500608 00000100:00100000:1.0:1788863612.397976:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226501120 00000100:00100000:1.0:1788863612.397980:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226501120 00000100:00100000:1.0:1788863612.398004:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226501248 00000100:00100000:1.0:1788863612.398007:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226501248 00000100:00100000:1.0:1788863612.398024:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863612.398032:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226500608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.398107:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226500608:12345-0@lo:400:kworker.0 Request processed in 76us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.398120:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863612.398142:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863612.398149:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226501120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.398178:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226501120:12345-0@lo:400:kworker.0 Request processed in 30us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.398184:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863612.398194:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788863612.398200:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226501248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.398224:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226501248:12345-0@lo:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.398230:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788863612.398249:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226501632 00000100:00100000:1.0:1788863612.398253:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226501632 00000100:00100000:2.0:1788863612.398573:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226500864:0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.398607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863612.398629:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226501376:0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.398649:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863612.398691:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788863612.398698:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226500480:0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.398725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863612.398749:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226500992:0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.398771:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863612.398970:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226501504:0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.399010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863612.399036:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500480 00000100:00100000:2.0:1788863612.399040:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500480 00000100:00100000:2.0:1788863612.399096:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788863612.399105:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226500480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.399145:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226500480:12345-0@lo:400:kworker.0 Request processed in 42us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863612.399152:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788863612.399183:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500736 00000100:00100000:2.0:1788863612.399186:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500736 00000100:00100000:2.0:1788863612.399221:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500992 00000100:00100000:2.0:1788863612.399224:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500992 00000100:00100000:2.0:1788863612.399236:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863612.399242:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226500736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.399447:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226501760 00000100:00100000:1.0:1788863612.399452:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226501760 00000100:00100000:1.0:1788863612.399473:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788863612.399480:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226501632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863612.399599:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226500864 00000100:00100000:0.0:1788863612.399610:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226500864 00000100:00100000:0.0:1788863612.399630:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226501376 00000100:00100000:0.0:1788863612.399632:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226501376 00000100:00100000:0.0:1788863612.399644:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226501504 00000100:00100000:0.0:1788863612.399646:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226501504 00000100:00100000:0.0:1788863612.399930:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788863612.399937:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226500864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400071:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226501632:12345-0@lo:400:kworker.0 Request processed in 591us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.400095:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788863612.400112:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788863612.400119:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226501760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400148:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226501760:12345-0@lo:400:kworker.0 Request processed in 30us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.400154:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788863612.400178:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863612.400183:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863612.400185:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788863612.400224:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d880 x1875759226501248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863612.400238:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226501248:0@lo:400:kworker.0 00010000:00080000:1.0:1788863612.400250:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543768700 x1875759226501760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863612.400258:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226501760:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400284:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226500608:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400294:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226501120:0@lo:400:kworker.0 00010000:00080000:1.0:1788863612.400303:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543769f80 x1875759226501632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863612.400311:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226501632:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400356:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788863612.400363:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226501376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400411:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226501376:12345-0@lo:400:kworker.0 Request processed in 49us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.400418:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788863612.400431:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788863612.400437:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226501504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400463:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226501504:12345-0@lo:400:kworker.0 Request processed in 26us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.400478:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788863612.400508:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788863612.400515:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226500992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.400547:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226500992:12345-0@lo:400:kworker.0 Request processed in 32us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.400553:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788863612.400675:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226500736:12345-0@lo:400:kworker.0 Request processed in 1432us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863612.400684:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863612.400723:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226500480:0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.400735:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226500992:0@lo:400:kworker.0 00010000:00080000:2.0:1788863612.400745:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54376b100 x1875759226501504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863612.400754:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226501504:0@lo:400:kworker.0 00000100:00100000:2.0:1788863612.400763:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226501376:0@lo:400:kworker.0 00000100:00100000:1.0:1788863612.401183:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226500736:0@lo:400:kworker.0 00000100:00100000:0.0:1788863612.401737:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226500864:12345-0@lo:400:kworker.0 Request processed in 1799us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863612.401746:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788863612.401930:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226500864:0@lo:400:kworker.0 00000100:00100000:0.0:1788863612.907549:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863612.907575:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226501888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863612.907660:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863612.907748:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226501888 00000100:00100000:0.0:1788863612.907757:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226501888 00000100:00100000:0.0:1788863612.907807:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863612.907816:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226501888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863612.907848:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863612.907895:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226501888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863612.907902:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788863612.907938:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681e2f100 x1875759226501888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863612.907955:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226501888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863612.908488:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863612.908501:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226502016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863612.908538:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863612.908569:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502016 00000100:00100000:1.0:1788863612.908574:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502016 00000100:00100000:1.0:1788863612.908596:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788863612.908603:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226502016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863612.908614:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863612.908644:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226502016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863612.908651:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788863612.908677:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543769f80 x1875759226502016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863612.908707:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226502016:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788863613.006982:0:11336:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:1.0:1788863613.100269:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863613.419757:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863613.419783:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226502144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863613.419860:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863613.420191:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502144 00000100:00100000:0.0:1788863613.420210:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502144 00000100:00100000:0.0:1788863613.420261:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788863613.420271:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226502144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863613.420321:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863613.420397:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226502144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863613.420405:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863613.420680:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226502144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863613.421307:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863613.421321:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226502272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863613.421384:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863613.421453:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502272 00000100:00100000:2.0:1788863613.421465:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502272 00000100:00100000:2.0:1788863613.421511:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788863613.421519:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226502272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863613.421544:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863613.421590:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226502272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863613.421596:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788863613.421673:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226502272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788863614.124527:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788863615.082446:0:11384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 06:33:33 EDT 2026 00010000:00010000:1.0:1788863615.147229:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863616.171289:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863616.495331:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863616.495369:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863616.495442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863616.495473:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459840 00000100:00100000:0.0:1788863616.495483:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459840 00000100:00100000:0.0:1788863616.495536:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459968 00000100:00100000:0.0:1788863616.495539:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459968 00000100:00100000:0.0:1788863616.495563:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 110 00000100:00100000:0.0:1788863616.495573:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205459840:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863616.495648:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205459840:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 76us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863616.495656:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 110 00000100:00100000:0.0:1788863616.495672:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00100000:0.0:1788863616.495678:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205459968:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863616.495701:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205459968:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863616.495706:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00080000:1.0:1788863616.496228:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863616.496234:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863616.496245:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205459712 00000100:00100000:3.0:1788863616.496253:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205459712 00000100:00100000:3.0:1788863616.496310:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 284 00000100:00100000:3.0:1788863616.496319:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2411:x1875759205459712:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863616.496370:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2411:x1875759205459712:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863616.496377:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 284 00000100:00100000:2.0:1788863617.003369:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226502400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863617.003450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863617.003537:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226502528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863617.003558:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863617.003664:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502400 00000100:00100000:1.0:1788863617.003673:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502400 00000100:00100000:1.0:1788863617.003735:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502528 00000100:00100000:1.0:1788863617.003739:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502528 00000100:00100000:1.0:1788863617.003760:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788863617.003771:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226502400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863617.003802:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788863617.003868:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863617.006598:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226502400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2818us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863617.006614:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788863617.006648:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788863617.006663:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226502528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863617.006691:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863617.006746:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226502528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863617.006753:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788863617.008294:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681e2e300 x1875759226502400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863617.008322:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226502400:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788863617.008338:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54376b800 x1875759226502528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863617.008350:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226502528:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788863617.196546:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863617.516870:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226502784:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.516942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863617.517003:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226502656:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.517010:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226503296:0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517051:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863617.517052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863617.517119:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226503168:0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517145:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863617.517172:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226503680:0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863617.517229:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788863617.517236:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226503040:0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863617.517283:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226503552:0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863617.517325:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502784 00000100:00100000:3.0:1788863617.517333:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502784 00000100:00100000:3.0:1788863617.517369:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503296 00000100:00100000:3.0:1788863617.517372:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503296 00000100:00100000:3.0:1788863617.517393:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503680 00000100:00100000:3.0:1788863617.517396:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503680 00000100:00100000:3.0:1788863617.517406:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503040 00000100:00100000:3.0:1788863617.517409:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503040 00000100:00100000:3.0:1788863617.517418:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503552 00000100:00100000:3.0:1788863617.517421:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503552 00000100:00100000:3.0:1788863617.517436:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788863617.517444:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226502784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517492:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226502784:12345-0@lo:400:kworker.0 Request processed in 49us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863617.517499:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788863617.517517:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788863617.517523:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226503296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517548:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226503296:12345-0@lo:400:kworker.0 Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863617.517553:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788863617.517564:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788863617.517569:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226503680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517609:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226503680:12345-0@lo:400:kworker.0 Request processed in 39us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863617.517615:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788863617.517627:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788863617.517633:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226503040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517657:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226503040:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863617.517662:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788863617.517672:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788863617.517678:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226503552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517703:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226503552:12345-0@lo:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863617.517709:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788863617.517754:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226503040:0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.517763:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226503552:0@lo:400:kworker.0 00010000:00080000:3.0:1788863617.517773:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360df80 x1875759226503680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863617.517783:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226503680:0@lo:400:kworker.0 00000100:00100000:2.0:1788863617.518103:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502656 00000100:00100000:2.0:1788863617.518108:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502656 00000100:00100000:2.0:1788863617.518141:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788863617.518149:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226502656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863617.518203:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226502656:12345-0@lo:400:kworker.0 Request processed in 55us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863617.518210:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788863617.518241:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503168 00000100:00100000:2.0:1788863617.518244:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503168 00000100:00100000:2.0:1788863617.518268:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788863617.518287:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226503168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863617.518318:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226503168:12345-0@lo:400:kworker.0 Request processed in 33us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863617.518324:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788863617.518475:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226502656:0@lo:400:kworker.0 00000100:00100000:3.0:1788863617.518486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226503168:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520089:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226503296:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520110:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226503808:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520176:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863617.520250:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226502784:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520260:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788863617.520267:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226502912:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520307:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863617.520333:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226503424:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863617.520383:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226503936:0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863617.520459:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503424 00000100:00100000:0.0:1788863617.520467:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503424 00000100:00100000:0.0:1788863617.520522:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788863617.520532:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226503424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520588:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226503424:12345-0@lo:400:kworker.0 Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863617.520596:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788863617.520631:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863617.520636:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863617.520648:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226502912 00000100:00100000:0.0:1788863617.520652:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226502912 00000100:00100000:0.0:1788863617.520682:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788863617.520689:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226502912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520740:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226502912:12345-0@lo:400:kworker.0 Request processed in 52us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863617.520748:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788863617.520785:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503808 00000100:00100000:0.0:1788863617.520789:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503808 00000100:00100000:0.0:1788863617.520821:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226503936 00000100:00100000:0.0:1788863617.520824:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226503936 00000100:00100000:0.0:1788863617.520846:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863617.520851:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226503808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520884:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226503808:12345-0@lo:400:kworker.0 Request processed in 33us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863617.520890:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863617.520900:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863617.520906:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226503936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863617.520933:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226503936:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863617.520939:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788863617.520959:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863617.520991:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226502912:0@lo:400:kworker.0 00010000:00080000:0.0:1788863617.521011:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543442a00 x1875759226503424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863617.521025:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226503424:0@lo:400:kworker.0 00010000:00080000:0.0:1788863617.521035:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360fb80 x1875759226503936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863617.521044:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226503936:0@lo:400:kworker.0 00010000:00080000:0.0:1788863617.521068:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360c700 x1875759226503808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863617.521250:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226503808:0@lo:400:kworker.0 00000100:00100000:0.0:1788863618.028060:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863618.028126:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226504064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863618.028185:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863618.028196:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226504192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863618.028229:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863618.028281:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863618.028396:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504064 00000100:00100000:2.0:1788863618.028406:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504064 00000100:00100000:2.0:1788863618.028454:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504192 00000100:00100000:2.0:1788863618.028457:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504192 00000100:00100000:2.0:1788863618.028476:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863618.028486:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226504064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863618.028527:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863618.028590:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226504064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863618.028607:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863618.028628:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788863618.028634:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226504192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863618.028649:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863618.028680:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226504192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863618.028687:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788863618.028726:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf0700 x1875759226504192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863618.028748:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226504192:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788863618.029189:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f2d80 x1875759226504064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863618.029206:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226504064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863618.221652:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863618.539275:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863618.539306:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226504320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863618.539432:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863618.539880:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504320 00000100:00100000:3.0:1788863618.539892:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504320 00000100:00100000:2.0:1788863618.539929:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863618.539941:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226504448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863618.539991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863618.540024:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504448 00000100:00100000:2.0:1788863618.540029:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504448 00000100:00100000:2.0:1788863618.540100:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788863618.540112:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226504448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863618.540163:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863618.540218:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226504448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863618.540225:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788863618.540296:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226504448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863618.540416:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863618.540436:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226504320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863618.540460:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788863618.540505:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226504320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863618.540512:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788863618.543021:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226504320:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788863619.244248:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863620.267442:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863621.296945:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863621.612975:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863621.613010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863621.613030:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863621.613057:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460096 00000100:00100000:3.0:1788863621.613069:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460096 00000100:00100000:3.0:1788863621.613150:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 286 00000100:00100000:3.0:1788863621.613161:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205460096:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863621.613252:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205460096:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863621.613260:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 286 00000100:00100000:0.0:1788863621.614396:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460352 00000100:00100000:0.0:1788863621.614410:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460352 00000100:00100000:0.0:1788863621.614472:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460224 00000100:00100000:0.0:1788863621.614476:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460224 00000100:00100000:0.0:1788863621.614502:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:0.0:1788863621.614513:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205460352:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863621.614578:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205460352:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 66us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863621.614585:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:0.0:1788863621.614601:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:0.0:1788863621.614608:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205460224:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863621.614631:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205460224:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863621.614637:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00080000:2.0:1788863621.614687:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863621.614698:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863622.132003:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226504576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863622.132206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863622.132899:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226504704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863622.132955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863622.138769:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504576 00000100:00100000:3.0:1788863622.138786:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504576 00000100:00100000:3.0:1788863622.144164:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504704 00000100:00100000:3.0:1788863622.144190:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504704 00000100:00100000:3.0:1788863622.144459:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863622.144472:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226504576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863622.144506:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863622.146057:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226504576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1584us (13846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863622.146068:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863622.146118:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863622.146129:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226504704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863622.146158:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863622.146224:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226504704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (13269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863622.146230:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788863622.146386:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360fb80 x1875759226504704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863622.146408:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226504704:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788863622.146655:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67adf0700 x1875759226504576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863622.146671:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226504576:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788863622.146696:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863622.316375:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863622.635561:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226504832:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.635582:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226505088:0@lo:400:kworker.0 00000100:00100000:3.0:1788863622.635589:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226504960:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.636715:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863622.636773:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226505344:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.639992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863622.640051:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226505856:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.640093:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863622.640156:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504832 00000100:00100000:1.0:1788863622.640164:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504832 00000100:00100000:1.0:1788863622.640216:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788863622.640224:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226504832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.640276:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226504832:12345-0@lo:400:kworker.0 Request processed in 53us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863622.640283:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788863622.640320:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505344 00000100:00100000:1.0:1788863622.640325:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505344 00000100:00100000:1.0:1788863622.640351:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788863622.640358:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226505344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.640391:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226505344:12345-0@lo:400:kworker.0 Request processed in 34us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863622.640398:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788863622.640437:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226504832:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.641703:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226505344:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642402:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863622.642452:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505856 00000100:00100000:0.0:1788863622.642461:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505856 00000100:00100000:0.0:1788863622.642517:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788863622.642526:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226505856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642582:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226505856:12345-0@lo:400:kworker.0 Request processed in 58us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.642589:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788863622.642611:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505088 00000100:00100000:0.0:1788863622.642615:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505088 00000100:00100000:0.0:1788863622.642635:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788863622.642641:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226505088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642672:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226505088:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.642678:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788863622.642692:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788863622.642724:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360f100 x1875759226505856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863622.642738:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226505856:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642763:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226505088:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226505600:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863622.642840:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505600 00000100:00100000:0.0:1788863622.642843:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505600 00000100:00100000:0.0:1788863622.642871:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788863622.642877:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226505600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642909:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226505600:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.642915:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788863622.642932:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863622.642945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788863622.642954:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360d180 x1875759226505600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863622.642965:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226505600:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.642969:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226505216:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.642972:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226506112:0@lo:400:kworker.0 00000100:00100000:3.0:1788863622.642979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226505472:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.643003:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863622.643023:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863622.643038:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226505728:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.643047:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226504960 00000100:00100000:0.0:1788863622.643051:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226504960 00000100:00100000:1.0:1788863622.643061:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863622.643093:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505216 00000100:00100000:0.0:1788863622.643096:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505216 00000100:00100000:0.0:1788863622.643114:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505728 00000100:00100000:0.0:1788863622.643117:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505728 00000100:00100000:0.0:1788863622.643140:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863622.643149:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226504960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863622.643181:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788863622.643193:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226505216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.643195:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226504960:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.643205:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863622.643230:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788863622.643237:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226505728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.644451:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226506112 00000100:00100000:1.0:1788863622.644461:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226506112 00000100:00100000:1.0:1788863622.644510:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788863622.644520:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226506112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.644577:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226506112:12345-0@lo:400:kworker.0 Request processed in 59us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863622.644584:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788863622.644623:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544002680 x1875759226506112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863622.644637:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226506112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.646804:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226505728:12345-0@lo:400:kworker.0 Request processed in 3559us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.646819:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788863622.646869:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863622.646875:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863622.647782:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226505216:12345-0@lo:400:kworker.0 Request processed in 4587us (4774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863622.647795:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788863622.648674:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863622.648725:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226505984:0@lo:400:kworker.0 00000100:00100000:3.0:1788863622.648786:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863622.648906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226504960:0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.651213:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505984 00000100:00100000:0.0:1788863622.651229:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505984 00000100:00100000:0.0:1788863622.651329:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863622.651340:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226505984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.651434:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226505984:12345-0@lo:400:kworker.0 Request processed in 97us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.651441:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863622.651472:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226505472 00000100:00100000:0.0:1788863622.651476:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226505472 00000100:00080000:3.0:1788863622.651484:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863622.651491:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863622.651509:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788863622.651516:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226505472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863622.651548:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226505472:12345-0@lo:400:kworker.0 Request processed in 33us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.651554:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788863622.651600:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226505472:0@lo:400:kworker.0 00010000:00080000:0.0:1788863622.651617:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360df80 x1875759226505984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863622.651627:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226505984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.657677:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226505216:0@lo:400:kworker.0 00000100:00100000:1.0:1788863622.657696:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226505728:0@lo:400:kworker.0 00000100:00100000:3.0:1788863623.147511:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226506240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863623.147592:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863623.147672:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226506240 00000100:00100000:3.0:1788863623.147680:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226506240 00000100:00100000:3.0:1788863623.147731:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788863623.147740:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226506240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863623.147769:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863623.147830:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226506240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863623.147837:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788863623.147875:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543442a00 x1875759226506240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863623.147901:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226506240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863623.150715:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863623.150740:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226506368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863623.150812:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863623.150929:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226506368 00000100:00100000:3.0:1788863623.150958:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226506368 00000100:00100000:3.0:1788863623.151040:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863623.151054:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226506368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863623.151133:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863623.151236:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226506368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 186us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863623.151244:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788863623.151548:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543442a00 x1875759226506368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863623.151573:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226506368:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863623.340119:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863623.659469:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226506496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863623.659616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863623.660184:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226506496 00000100:00100000:3.0:1788863623.660196:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226506496 00000100:00100000:3.0:1788863623.660270:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788863623.660281:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226506496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863623.660333:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863623.660670:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863623.660684:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226506624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863623.660725:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863623.660793:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226506624 00000100:00100000:1.0:1788863623.660797:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226506624 00000100:00100000:1.0:1788863623.660819:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788863623.660840:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226506624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863623.660861:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788863623.660896:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226506624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863623.660903:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788863623.660951:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226506624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863623.662244:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226506496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1953us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863623.662257:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863623.662413:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226506496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788863624.364376:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863625.387647:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863626.412328:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863626.733240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863626.733284:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863626.733307:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863626.733333:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460480 00000100:00100000:1.0:1788863626.733344:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460480 00000100:00100000:1.0:1788863626.733397:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 288 00000100:00100000:1.0:1788863626.733407:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205460480:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863626.733482:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205460480:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863626.733490:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 288 00000100:00100000:1.0:1788863626.733522:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460608 00000100:00100000:1.0:1788863626.733526:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460608 00000100:00100000:1.0:1788863626.733557:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460736 00000100:00100000:1.0:1788863626.733559:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460736 00000100:00100000:1.0:1788863626.733578:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:1.0:1788863626.733584:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205460608:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863626.733610:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205460608:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863626.733623:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:1.0:1788863626.733635:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:1.0:1788863626.733640:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205460736:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863626.733664:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205460736:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863626.733670:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00080000:1.0:1788863626.733799:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863626.733803:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863627.243482:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863627.247763:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226506752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863627.247923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863627.248029:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226506752 00000100:00100000:2.0:1788863627.248040:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226506752 00000100:00100000:2.0:1788863627.248145:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788863627.248158:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226506752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863627.248213:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863627.248272:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226506752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863627.248280:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788863627.248308:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788863627.248350:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544001f80 x1875759226506752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863627.248392:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226506752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863627.254901:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226506880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863627.255014:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863627.255216:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226506880 00000100:00100000:0.0:1788863627.255227:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226506880 00000100:00100000:0.0:1788863627.255301:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788863627.255310:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226506880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863627.255339:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788863627.262662:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863627.264495:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226506880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9172us (9468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863627.264596:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788863627.265363:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543441880 x1875759226506880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863627.265404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226506880:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788863627.436529:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863627.756806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226507392:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.756906:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.756999:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226507904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757025:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757111:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863627.757119:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226507008:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757154:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757180:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226507520:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757229:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226508032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757251:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757281:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226507136:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757307:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757329:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226507648:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757565:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757581:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226508160:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757611:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757644:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863627.757651:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226507264:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757681:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757701:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226507776:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757722:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757732:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226508288:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.757772:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863627.757815:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507392 00000100:00100000:3.0:1788863627.757826:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507392 00000100:00100000:3.0:1788863627.757877:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507904 00000100:00100000:3.0:1788863627.757880:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507904 00000100:00100000:3.0:1788863627.757907:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508032 00000100:00100000:3.0:1788863627.757910:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508032 00000100:00100000:3.0:1788863627.757934:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507136 00000100:00100000:3.0:1788863627.757937:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507136 00000100:00100000:3.0:1788863627.757948:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507648 00000100:00100000:3.0:1788863627.757950:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507648 00000100:00100000:3.0:1788863627.757978:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507776 00000100:00100000:3.0:1788863627.757981:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507776 00000100:00100000:3.0:1788863627.758000:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788863627.758011:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226507392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.758121:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226507392:12345-0@lo:400:kworker.0 Request processed in 110us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863627.758129:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788863627.758151:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788863627.758157:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226507904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.758190:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226507904:12345-0@lo:400:kworker.0 Request processed in 33us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863627.758197:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788863627.758208:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788863627.758215:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226508032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.758244:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226508032:12345-0@lo:400:kworker.0 Request processed in 30us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863627.758250:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788863627.758261:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788863627.758267:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226507136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.758299:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226507136:12345-0@lo:400:kworker.0 Request processed in 32us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863627.758305:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788863627.758316:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788863627.758328:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226507648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863627.758694:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508160 00000100:00100000:0.0:1788863627.758703:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508160 00000100:00100000:0.0:1788863627.758744:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508288 00000100:00100000:0.0:1788863627.758748:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508288 00000100:00100000:0.0:1788863627.758780:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788863627.758789:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226508160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863627.758837:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226508160:12345-0@lo:400:kworker.0 Request processed in 50us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863627.758843:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788863627.758858:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788863627.758865:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226508288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863627.758895:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226508288:12345-0@lo:400:kworker.0 Request processed in 31us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863627.758902:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788863627.759263:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788863627.759276:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226507776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863627.759323:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226507776:12345-0@lo:400:kworker.0 Request processed in 51us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863627.759329:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1788863627.759442:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863627.759448:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863627.759451:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863627.759562:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507520 00000100:00100000:0.0:1788863627.759569:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507520 00000100:00100000:0.0:1788863627.759611:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507264 00000100:00100000:0.0:1788863627.759623:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507264 00000100:00100000:0.0:1788863627.759642:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863627.759649:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226507520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863627.759691:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226507520:12345-0@lo:400:kworker.0 Request processed in 43us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863627.759698:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863627.759711:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788863627.759718:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671282450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226507264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863627.759746:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671282450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226507264:12345-0@lo:400:kworker.0 Request processed in 30us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863627.759752:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788863627.760498:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226507648:12345-0@lo:400:kworker.0 Request processed in 2166us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863627.760509:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788863627.760578:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226507264:0@lo:400:kworker.0 00010000:00080000:3.0:1788863627.760598:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340a680 x1875759226507776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863627.760611:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226507776:0@lo:400:kworker.0 00010000:00080000:3.0:1788863627.760625:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676157100 x1875759226508288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863627.760633:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226508288:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.760647:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226507136:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.760658:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226507648:0@lo:400:kworker.0 00010000:00080000:3.0:1788863627.760669:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676156300 x1875759226508160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863627.760677:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226508160:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.760731:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226507520:0@lo:400:kworker.0 00010000:00080000:3.0:1788863627.760746:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676156680 x1875759226508032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863627.760755:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226508032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.760769:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226507392:0@lo:400:kworker.0 00000100:00100000:3.0:1788863627.760825:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226507904:0@lo:400:kworker.0 00000100:00100000:0.0:1788863627.769531:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226507008 00000100:00100000:0.0:1788863627.769547:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226507008 00000100:00100000:0.0:1788863627.769608:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788863627.769619:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226507008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863627.769713:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226507008:12345-0@lo:400:kworker.0 Request processed in 96us (12557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863627.769721:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788863627.771134:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226507008:0@lo:400:kworker.0 00000100:00100000:1.0:1788863628.267974:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226508416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863628.268047:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863628.268236:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226508544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863628.268273:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863628.268368:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508416 00000100:00100000:2.0:1788863628.268376:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508416 00000100:00100000:2.0:1788863628.268410:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508544 00000100:00100000:2.0:1788863628.268413:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508544 00000100:00100000:2.0:1788863628.268426:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788863628.268434:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226508416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863628.268462:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863628.268643:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226508416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 208us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863628.268652:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788863628.268668:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788863628.268675:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226508544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863628.268685:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863628.268720:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226508544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863628.268741:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788863628.268804:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544000000 x1875759226508544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863628.268821:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226508544:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788863628.268871:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5439f0700 x1875759226508416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863628.268884:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226508416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863628.459748:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863628.779416:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863628.779440:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226508672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863628.781158:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863628.781440:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508672 00000100:00100000:1.0:1788863628.781451:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508672 00000100:00100000:1.0:1788863628.781525:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788863628.781535:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226508672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863628.781591:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788863628.781660:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226508672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863628.781667:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788863628.782315:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863628.782332:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226508800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863628.782384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863628.782488:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508800 00000100:00100000:1.0:1788863628.782493:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508800 00000100:00100000:1.0:1788863628.782534:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788863628.782541:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226508800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863628.782562:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863628.782614:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226508800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863628.782620:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788863628.783134:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226508800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863628.785209:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54376a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226508672:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788863629.483347:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863630.507562:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863631.531736:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863631.691834:0:12014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:33:50 (1788863630) === 00000100:00100000:3.0:1788863631.869223:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863631.869491:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863631.870062:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460992 00000100:00100000:3.0:1788863631.870072:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460992 00000100:00100000:3.0:1788863631.870169:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:3.0:1788863631.870180:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205460992:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863631.870268:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205460992:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 91us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863631.870276:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:3.0:1788863631.870428:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205460864 00000100:00100000:3.0:1788863631.870433:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205460864 00000100:00100000:3.0:1788863631.870462:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 290 00000100:00100000:3.0:1788863631.870471:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205460864:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863631.870497:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+10:2410:x1875759205460864:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 30us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863631.870593:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 290 00000100:00080000:3.0:1788863631.870630:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863631.872120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863631.873209:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205461120 00000100:00100000:3.0:1788863631.873222:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205461120 00000100:00100000:3.0:1788863631.873300:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:3.0:1788863631.873311:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205461120:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863631.873390:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205461120:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 81us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863631.873397:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00080000:3.0:1788863631.873498:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863632.364549:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226508928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863632.364619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.364769:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226508928 00000100:00100000:2.0:1788863632.364777:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226508928 00000100:00100000:2.0:1788863632.364840:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788863632.364851:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226508928:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788863632.365020:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788863632.365110:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863632.365167:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226508928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 318us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.365174:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788863632.365263:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d6680 x1875759226508928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863632.365284:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226508928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863632.366213:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226509056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863632.366284:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.366443:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509056 00000100:00100000:1.0:1788863632.366449:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509056 00000100:00100000:1.0:1788863632.366514:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788863632.366522:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226509056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863632.366540:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788863632.366628:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863632.375230:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226509056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8696us (8933us total) trans 0 rc 0/0 00010000:00080000:2.0:1788863632.375382:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544000700 x1875759226509056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863632.375410:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226509056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863632.378990:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788863632.551773:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863632.552040:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205461248 00000100:00100000:1.0:1788863632.552052:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205461248 00000100:00100000:1.0:1788863632.552142:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 291 00000100:00100000:1.0:1788863632.552154:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+10:8738:x1875759205461248:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788863632.552174:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863632.552197:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650115800/0xf569beb9d4b68e11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187dca expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.552235:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650115800/0xf569beb9d4b68e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dca expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.552247:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650115800/0xf569beb9d4b68e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dca expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.552256:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650115800, rc 0) 00000100:00100000:1.0:1788863632.552326:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+11:8738:x1875759205461248:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 175us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.552334:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 291 00010000:00010000:0.0:1788863632.555797:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863632.563845:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.565514:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205461376 00000100:00100000:0.0:1788863632.565531:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205461376 00000100:00100000:0.0:1788863632.565614:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 292 00000100:00100000:0.0:1788863632.565624:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+11:8738:x1875759205461376:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788863632.565824:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+11:8738:x1875759205461376:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 193us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.565833:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 292 00000100:00100000:0.0:1788863632.569442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863632.569529:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205461504 00000100:00100000:3.0:1788863632.569540:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205461504 00000100:00100000:3.0:1788863632.569596:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 293 00000100:00100000:3.0:1788863632.569607:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+11:8738:x1875759205461504:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788863632.569805:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+11:8738:x1875759205461504:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 200us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.569813:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 293 00000100:00100000:3.0:1788863632.573862:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863632.574205:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205461632 00000100:00100000:1.0:1788863632.574216:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205461632 00000100:00100000:1.0:1788863632.574271:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 294 00000100:00100000:1.0:1788863632.574281:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+11:8742:x1875759205461632:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863632.574539:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+11:8742:x1875759205461632:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 258us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.574557:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 294 00000100:00100000:1.0:1788863632.636476:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.636657:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205461760 00000100:00100000:0.0:1788863632.636670:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205461760 00000100:00100000:0.0:1788863632.636879:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 295 00000100:00100000:0.0:1788863632.636892:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+11:8742:x1875759205461760:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863632.637125:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+11:8742:x1875759205461760:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 184us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.637133:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 295 00000100:00100000:0.0:1788863632.644386:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863632.644624:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205461888 00000100:00100000:1.0:1788863632.644634:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205461888 00000100:00100000:1.0:1788863632.644692:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 296 00000100:00100000:1.0:1788863632.644703:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+11:8742:x1875759205461888:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863632.644888:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+11:8742:x1875759205461888:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 187us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.644896:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 296 00000100:00100000:1.0:1788863632.651725:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.652062:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462016 00000100:00100000:0.0:1788863632.652102:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462016 00000100:00100000:0.0:1788863632.652172:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 297 00000100:00100000:0.0:1788863632.652185:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+11:8738:x1875759205462016:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788863632.652203:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863632.652221:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d91400/0xf569beb9d4b68e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187dfb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.652255:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d91400/0xf569beb9d4b68e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dfb expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.652268:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d91400/0xf569beb9d4b68e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dfb expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.652278:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d91400, rc 0) 00000100:00100000:0.0:1788863632.652367:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+12:8738:x1875759205462016:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 185us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.652374:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 297 00000100:00100000:2.0:1788863632.657378:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863632.658350:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462144 00000100:00100000:3.0:1788863632.658362:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462144 00000100:00100000:3.0:1788863632.658427:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 298 00000100:00100000:3.0:1788863632.658437:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+12:8738:x1875759205462144:12345-192.168.204.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788863632.658497:0:6532:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788863632.658515:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788863632.658519:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788863632.658523:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788863632.658526:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788863632.658528:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788863632.661672:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+12:8738:x1875759205462144:12345-192.168.204.35@tcp:256:mount.lustre.0 Request processed in 3224us (4292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.661689:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 298 00000100:00100000:1.0:1788863632.670808:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863632.670982:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462272 00000100:00100000:3.0:1788863632.670993:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462272 00000100:00100000:3.0:1788863632.671055:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 299 00000100:00100000:3.0:1788863632.671066:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+12:8738:x1875759205462272:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788863632.671119:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863632.671139:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e02 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.671178:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.671189:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.671198:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167da00, rc 0) 00000100:00100000:3.0:1788863632.671253:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:8738:x1875759205462272:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 189us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.671260:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 299 00000100:00100000:2.0:1788863632.675474:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863632.676411:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462400 00000100:00100000:1.0:1788863632.676423:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462400 00000100:00100000:1.0:1788863632.676488:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 300 00000100:00100000:1.0:1788863632.676814:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:8738:x1875759205462400:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788863632.676995:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:8738:x1875759205462400:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 497us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.677004:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 300 00000100:00100000:1.0:1788863632.682372:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.682494:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462528 00000100:00100000:0.0:1788863632.682582:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462528 00000100:00100000:0.0:1788863632.682645:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 301 00000100:00100000:0.0:1788863632.682656:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:8738:x1875759205462528:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788863632.683593:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:8738:x1875759205462528:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 934us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.683605:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 301 00000100:00100000:3.0:1788863632.690007:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863632.692088:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462656 00000100:00100000:1.0:1788863632.692104:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462656 00000100:00100000:1.0:1788863632.692325:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 302 00000100:00100000:1.0:1788863632.692354:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:8744:x1875759205462656:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863632.692549:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:8744:x1875759205462656:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 197us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.692557:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 302 00000100:00100000:2.0:1788863632.699163:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.701921:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462784 00000100:00100000:0.0:1788863632.701937:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462784 00000100:00100000:0.0:1788863632.702031:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 303 00000100:00100000:0.0:1788863632.702042:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:8744:x1875759205462784:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863632.702258:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:8744:x1875759205462784:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 217us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.702267:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 303 00000100:00100000:2.0:1788863632.715636:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863632.715694:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.715771:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463552 00000100:00100000:0.0:1788863632.715782:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463552 00000100:00100000:0.0:1788863632.715847:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463680 00000100:00100000:0.0:1788863632.715851:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463680 00000100:00100000:0.0:1788863632.715887:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:0.0:1788863632.715898:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205463552:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863632.715985:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205463552:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 77us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.715993:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:0.0:1788863632.716025:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:0.0:1788863632.716032:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205463680:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863632.716059:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205463680:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.716065:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:2.0:1788863632.721852:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863632.721902:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863632.722014:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205462912 00000100:00100000:3.0:1788863632.722025:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205462912 00000100:00100000:3.0:1788863632.722069:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463168 00000100:00100000:3.0:1788863632.722120:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463168 00000100:00100000:3.0:1788863632.722155:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:3.0:1788863632.722163:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875759205462912:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788863632.722199:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 37081b3d-46f9-4ae6-9395-ddf0b5561d0d@192.168.204.35@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:3.0:1788863632.722239:0:6537:0:(genops.c:1384:class_connect()) connect: client 37081b3d-46f9-4ae6-9395-ddf0b5561d0d, cookie 0xf569beb9d4b68e26 00000004:00100000:3.0:1788863632.722265:0:6537:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788863632.722461:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e543a47800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863632.722719:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2407:x1875759205462912:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 554us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.722727:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:3.0:1788863632.722746:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788863632.722751:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875759205463168:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788863632.722768:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 37081b3d-46f9-4ae6-9395-ddf0b5561d0d@192.168.204.35@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:3.0:1788863632.722794:0:6537:0:(genops.c:1384:class_connect()) connect: client 37081b3d-46f9-4ae6-9395-ddf0b5561d0d, cookie 0xf569beb9d4b68e2d 00000004:00100000:3.0:1788863632.722807:0:6537:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788863632.722863:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e543a46800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863632.722887:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2407:x1875759205463168:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 134us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.722895:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:2.0:1788863632.737817:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863632.740772:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463040 00000100:00100000:3.0:1788863632.740785:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463040 00000100:00080000:1.0:1788863632.741390:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863632.741529:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:2.0:1788863632.741540:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:0:x1875759205463040:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788863632.741599:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863632.741688:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:0:x1875759205463040:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 150us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.741695:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:1.0:1788863632.741823:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.749741:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463424 00000100:00100000:0.0:1788863632.749758:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463424 00000100:00100000:2.0:1788863632.750861:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:2.0:1788863632.750882:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205463424:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788863632.750915:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863632.751006:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205463424:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 134us (9182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.751013:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:1.0:1788863632.756775:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863632.758891:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463296 00000100:00100000:3.0:1788863632.758906:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463296 00000100:00080000:1.0:1788863632.759281:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863632.759930:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:0.0:1788863632.759947:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:0:x1875759205463296:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788863632.759997:0:10368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863632.760116:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:0:x1875759205463296:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 174us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.760123:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1788863632.763757:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.764359:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463808 00000100:00100000:0.0:1788863632.764370:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463808 00000100:00100000:0.0:1788863632.764565:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:0.0:1788863632.764575:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205463808:12345-192.168.204.35@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788863632.764734:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205463808:12345-192.168.204.35@tcp:40:mount.lustre.0 Request processed in 159us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.764746:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:1.0:1788863632.769281:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.769385:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205463936 00000100:00100000:0.0:1788863632.769406:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205463936 00000100:00100000:0.0:1788863632.769463:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:0.0:1788863632.769472:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2407:x1875759205463936:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788863632.769508:0:8451:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 37081b3d-46f9-4ae6-9395-ddf0b5561d0d@192.168.204.35@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:0.0:1788863632.769554:0:8451:0:(genops.c:1384:class_connect()) connect: client 37081b3d-46f9-4ae6-9395-ddf0b5561d0d, cookie 0xf569beb9d4b68e34 00002000:00100000:0.0:1788863632.769566:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 37081b3d-46f9-4ae6-9395-ddf0b5561d0d/ffff89e67c4ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788863632.769577:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788863632.769652:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788863632.769684:0:8451:0:(import.c:65:import_set_state_nolock()) ffff89e67c4ce800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863632.769770:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2407:x1875759205463936:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 296us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.769778:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:3.0:1788863632.770590:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863632.770625:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863632.770806:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464192 00000100:00100000:1.0:1788863632.770813:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464192 00000100:00100000:1.0:1788863632.770873:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:1.0:1788863632.770883:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205464192:12345-192.168.204.35@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788863632.770956:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205464192:12345-192.168.204.35@tcp:900:mount.lustre.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.770979:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:0.0:1788863632.771867:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464064 00000100:00100000:0.0:1788863632.771876:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464064 00000100:00100000:0.0:1788863632.771921:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:0.0:1788863632.771937:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1875759205464064:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788863632.771966:0:8452:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 37081b3d-46f9-4ae6-9395-ddf0b5561d0d@192.168.204.35@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:0.0:1788863632.772004:0:8452:0:(genops.c:1384:class_connect()) connect: client 37081b3d-46f9-4ae6-9395-ddf0b5561d0d, cookie 0xf569beb9d4b68e3b 00002000:00100000:0.0:1788863632.772015:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 37081b3d-46f9-4ae6-9395-ddf0b5561d0d/ffff89e67c4c8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788863632.772032:0:8452:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788863632.772136:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788863632.772165:0:8452:0:(import.c:65:import_set_state_nolock()) ffff89e67c4cd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863632.772212:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2407:x1875759205464064:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 274us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.772220:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:3.0:1788863632.773342:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863632.773484:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464320 00000100:00100000:0.0:1788863632.773491:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464320 00000100:00100000:0.0:1788863632.773589:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1788863632.773599:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205464320:12345-192.168.204.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788863632.774032:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788863632.774220:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:8738:x1875759205464320:12345-192.168.204.35@tcp:33:mount.lustre.0 Request processed in 621us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.774228:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1788863632.881014:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226509184:0@lo:400:kworker.0 00000100:00100000:0.0:1788863632.881134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.881327:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509184 00000100:00100000:1.0:1788863632.881336:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509184 00000100:00100000:1.0:1788863632.881406:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788863632.881415:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226509184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.881614:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226509312:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.881651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.881691:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509312 00000100:00100000:2.0:1788863632.881696:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509312 00000100:00100000:2.0:1788863632.881726:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788863632.881733:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226509312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.881769:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226509312:12345-0@lo:400:kworker.0 Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.881775:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788863632.881811:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226509312:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.882704:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226509440:0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.882725:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226509568:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.882745:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863632.882750:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863632.882783:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509568 00000100:00100000:3.0:1788863632.882788:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509568 00000100:00100000:2.0:1788863632.882803:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863632.882810:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226509696:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.882853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.882894:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509440 00000100:00100000:2.0:1788863632.882898:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509440 00000100:00100000:2.0:1788863632.882927:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509696 00000100:00100000:2.0:1788863632.882930:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509696 00000100:00100000:2.0:1788863632.882944:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788863632.882951:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226509440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883002:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226509440:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.883009:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788863632.883023:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788863632.883029:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226509696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883060:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226509696:12345-0@lo:400:kworker.0 Request processed in 32us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.883066:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788863632.883112:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226509696:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883139:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226509440:0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.883155:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788863632.883161:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883167:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226509824:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883191:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.883258:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226509952:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863632.883424:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226509568:12345-0@lo:400:kworker.0 Request processed in 263us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.883431:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788863632.883442:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509824 00000100:00100000:3.0:1788863632.883445:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509824 00000100:00100000:2.0:1788863632.883445:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226509952 00000100:00100000:2.0:1788863632.883448:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226509952 00000100:00100000:3.0:1788863632.883470:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788863632.883475:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226509824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883488:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788863632.883495:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226509952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.883507:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226509824:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.883525:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788863632.883536:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226509952:12345-0@lo:400:kworker.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00080000:3.0:1788863632.883542:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863632.883542:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788863632.883547:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863632.883562:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226509824:0@lo:400:kworker.0 00010000:00080000:2.0:1788863632.883563:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e6712ab800 x1875759226509952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863632.883584:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226509568:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883586:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226509952:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883619:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863632.883625:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226510080:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883651:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.883707:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226510464:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883728:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.883763:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863632.883770:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226510592:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883791:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.883814:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510080 00000100:00100000:2.0:1788863632.883818:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510080 00000100:00100000:2.0:1788863632.883841:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510592 00000100:00100000:2.0:1788863632.883844:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510592 00000100:00100000:2.0:1788863632.883879:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863632.883886:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226510080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883920:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226510080:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.883926:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863632.883938:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788863632.883944:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226510592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.883981:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226510592:12345-0@lo:400:kworker.0 Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.883993:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788863632.884024:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681caa300 x1875759226510592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863632.884033:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226510592:0@lo:400:kworker.0 00010000:00080000:2.0:1788863632.884043:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e6712ab800 x1875759226510080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863632.884052:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226510080:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.884131:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226510336:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.884155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.884173:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788863632.884179:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226510208:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.884198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.884213:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226510720:0@lo:400:kworker.0 00000100:00100000:2.0:1788863632.884231:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.884253:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510208 00000100:00100000:2.0:1788863632.884256:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510208 00000100:00100000:3.0:1788863632.884764:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510464 00000100:00100000:3.0:1788863632.884770:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510464 00000100:00100000:3.0:1788863632.885533:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510336 00000100:00100000:3.0:1788863632.885540:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510336 00000100:00100000:3.0:1788863632.885566:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863632.885576:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226510464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.886054:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226510464:12345-0@lo:400:kworker.0 Request processed in 479us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.886092:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863632.886111:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788863632.886117:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226510336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.886154:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226510336:12345-0@lo:400:kworker.0 Request processed in 38us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.886159:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1788863632.886303:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863632.886308:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863632.886311:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863632.886348:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226510336:0@lo:400:kworker.0 00010000:00080000:3.0:1788863632.886389:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca8380 x1875759226510464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863632.886471:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226510464:0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.886530:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510720 00000100:00100000:3.0:1788863632.886536:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510720 00000100:00100000:3.0:1788863632.886564:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788863632.886571:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226510208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.886611:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226510208:12345-0@lo:400:kworker.0 Request processed in 41us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.886617:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788863632.886628:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863632.886714:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226510720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863632.886746:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226510720:12345-0@lo:400:kworker.0 Request processed in 35us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.886752:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788863632.886754:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788863632.886779:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681caa680 x1875759226510208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863632.886789:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226510208:0@lo:400:kworker.0 00010000:00080000:2.0:1788863632.886800:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681caa300 x1875759226510720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863632.886808:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226510720:0@lo:400:kworker.0 00000100:00100000:1.0:1788863632.887048:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226509184:12345-0@lo:400:kworker.0 Request processed in 5632us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.887057:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788863632.887106:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226509184:0@lo:400:kworker.0 00000100:00100000:2.0:1788863633.388381:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226510848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863633.388479:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863633.388751:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510848 00000100:00100000:0.0:1788863633.388772:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510848 00000100:00100000:0.0:1788863633.388822:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788863633.388832:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226510848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863633.388860:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863633.388916:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226510848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863633.388923:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788863633.389380:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544003b80 x1875759226510848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863633.389411:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226510848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863633.390040:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226510976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863633.390106:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863633.391109:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226510976 00000100:00100000:1.0:1788863633.391120:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226510976 00000100:00100000:1.0:1788863633.391489:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788863633.391510:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226510976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863633.391534:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863633.391859:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226510976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863633.391869:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788863633.392754:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e655c46300 x1875759226510976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863633.392793:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226510976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863633.579677:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863633.900098:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863633.900129:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226511104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863633.900467:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863633.900614:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226511104 00000100:00100000:1.0:1788863633.900625:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226511104 00000100:00100000:1.0:1788863633.900703:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788863633.900715:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226511104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863633.900761:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863633.901488:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863633.901505:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226511232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863633.901567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863633.901622:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226511232 00000100:00100000:2.0:1788863633.901629:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226511232 00000100:00100000:1.0:1788863633.901791:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226511104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1078us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863633.901800:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788863633.901830:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788863633.901838:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226511232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863633.902060:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226511104:0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863633.902228:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863633.902417:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226511232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 580us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863633.902425:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788863633.902487:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226511232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788863634.604506:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863635.627677:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863636.651816:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863637.483444:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226511360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863637.483538:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863637.483569:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863637.483584:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226511488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863637.483674:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863637.483757:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226511360 00000100:00100000:0.0:1788863637.483765:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226511360 00000100:00100000:0.0:1788863637.483804:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226511488 00000100:00100000:0.0:1788863637.483807:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226511488 00000100:00100000:0.0:1788863637.483824:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863637.483834:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226511360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863637.483863:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788863637.483961:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863637.497511:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226511360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13668us (13965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863637.497764:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863637.497848:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788863637.497862:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226511488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863637.497900:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788863637.511954:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d5c00 x1875759226511360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863637.512008:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226511360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863637.512624:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226511488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14764us (28946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863637.512638:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788863637.513134:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544000e00 x1875759226511488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863637.513155:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226511488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863637.675431:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863637.995518:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226512000:0@lo:400:kworker.0 00000100:00100000:3.0:1788863637.995593:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226511744:0@lo:400:kworker.0 00000100:00100000:0.0:1788863637.996284:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226511616:0@lo:400:kworker.0 00000100:00100000:2.0:1788863638.008133:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863638.008268:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226512512:0@lo:400:kworker.0 00000100:00100000:2.0:1788863638.008334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863638.008363:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226513024:0@lo:400:kworker.0 00000100:00100000:2.0:1788863638.008388:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863638.008435:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512000 00000100:00100000:2.0:1788863638.008444:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512000 00000100:00100000:2.0:1788863638.008501:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788863638.008511:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226512000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863638.008568:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226512000:12345-0@lo:400:kworker.0 Request processed in 58us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863638.008575:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788863638.008597:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512512 00000100:00100000:2.0:1788863638.008601:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512512 00000100:00100000:1.0:1788863638.009920:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863638.011958:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513024 00000100:00100000:2.0:1788863638.011967:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513024 00000100:00100000:2.0:1788863638.012005:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863638.012018:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226512512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863638.012072:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863638.012118:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226512512:12345-0@lo:400:kworker.0 Request processed in 103us (3782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863638.012122:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464576 00000100:00100000:1.0:1788863638.012128:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464576 00000100:00100000:2.0:1788863638.012129:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863638.012153:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788863638.012161:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226513024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863638.012167:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464832 00000100:00100000:1.0:1788863638.012171:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464832 00000100:00100000:1.0:1788863638.012193:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:2.0:1788863638.012204:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226513024:12345-0@lo:400:kworker.0 Request processed in 42us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863638.012205:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205464576:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863638.012218:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788863638.012283:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205464576:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 83us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863638.012290:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:1.0:1788863638.012306:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:1.0:1788863638.012313:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205464832:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863638.012336:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205464832:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863638.012341:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:1.0:1788863638.012377:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863638.016637:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465088 00000100:00100000:2.0:1788863638.016655:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465088 00000100:00100000:2.0:1788863638.016959:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:2.0:1788863638.016971:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205465088:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863638.019150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863638.019557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863638.019608:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226512128:0@lo:400:kworker.0 00000100:00100000:0.0:1788863638.019651:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863638.019687:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512128 00000100:00100000:0.0:1788863638.019694:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512128 00000100:00100000:0.0:1788863638.019743:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788863638.019751:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226512128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863638.019797:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226512128:12345-0@lo:400:kworker.0 Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863638.019803:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788863638.019841:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226512128:0@lo:400:kworker.0 00000100:00100000:0.0:1788863638.019849:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226512640:0@lo:400:kworker.0 00000100:00100000:1.0:1788863638.020752:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863638.020755:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226511744 00000100:00100000:3.0:1788863638.020762:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226511744 00000100:00100000:3.0:1788863638.020796:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788863638.020803:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226511744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.020854:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226511744:12345-0@lo:400:kworker.0 Request processed in 52us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.020861:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788863638.020926:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226511744:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.020937:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226512256:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.020965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863638.021007:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512256 00000100:00100000:3.0:1788863638.021011:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512256 00000100:00100000:3.0:1788863638.021038:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788863638.021045:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226512256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021091:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226512256:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.021098:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788863638.021124:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226512256:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021132:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226512768:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863638.021172:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512768 00000100:00100000:3.0:1788863638.021175:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512768 00000100:00100000:3.0:1788863638.021199:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788863638.021205:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226512768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021235:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226512768:12345-0@lo:400:kworker.0 Request processed in 30us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.021241:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788863638.021265:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226512768:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021288:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863638.021296:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226511872:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863638.021346:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226511872 00000100:00100000:3.0:1788863638.021350:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226511872 00000100:00100000:3.0:1788863638.021382:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788863638.021389:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226511872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021422:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226511872:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.021435:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788863638.021461:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226511872:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021468:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226512384:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021490:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863638.021508:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512384 00000100:00100000:3.0:1788863638.021512:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512384 00000100:00100000:3.0:1788863638.021536:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788863638.021542:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226512384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021571:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226512384:12345-0@lo:400:kworker.0 Request processed in 29us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.021577:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:3.0:1788863638.021612:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d6680 x1875759226512384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863638.021624:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226512384:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021631:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226512896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021653:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863638.021671:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512896 00000100:00100000:3.0:1788863638.021674:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512896 00000100:00100000:3.0:1788863638.021693:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788863638.021700:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226512896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.021729:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226512896:12345-0@lo:400:kworker.0 Request processed in 30us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.021735:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00080000:3.0:1788863638.021760:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca9c00 x1875759226512896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863638.021778:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226512896:0@lo:400:kworker.0 00000100:00100000:0.0:1788863638.023625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863638.023703:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226513152:0@lo:400:kworker.0 00000100:00100000:0.0:1788863638.023755:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863638.026204:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226512640 00000100:00100000:3.0:1788863638.026221:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226512640 00000100:00100000:3.0:1788863638.026285:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513152 00000100:00100000:3.0:1788863638.026289:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513152 00000100:00100000:3.0:1788863638.026315:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863638.026325:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226512640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.026993:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226512640:12345-0@lo:400:kworker.0 Request processed in 666us (7105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.027002:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863638.027023:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788863638.027031:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226513152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.027113:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226513152:12345-0@lo:400:kworker.0 Request processed in 84us (3357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.027119:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788863638.027141:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863638.027147:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863638.027149:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863638.027152:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788863638.027193:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681caa300 x1875759226512512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863638.027208:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226512512:0@lo:400:kworker.0 00010000:00080000:3.0:1788863638.027220:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676155c00 x1875759226513024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863638.027227:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226513024:0@lo:400:kworker.0 00000100:00100000:3.0:1788863638.027315:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226512000:0@lo:400:kworker.0 00000100:00100000:1.0:1788863638.027756:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863638.027888:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226511616 00000100:00100000:0.0:1788863638.027902:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226511616 00010000:00080000:3.0:1788863638.027921:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681caa680 x1875759226512640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863638.027934:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226512640:0@lo:400:kworker.0 00000100:00100000:0.0:1788863638.027950:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464448 00010000:00080000:3.0:1788863638.027952:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676154000 x1875759226513152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863638.027955:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464704 00000100:00100000:0.0:1788863638.027956:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464448 00000100:00100000:1.0:1788863638.027963:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464704 00000100:00100000:3.0:1788863638.027968:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226513152:0@lo:400:kworker.0 00000100:00100000:0.0:1788863638.027982:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788863638.027994:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226511616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863638.028013:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:1.0:1788863638.028023:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205464704:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863638.028049:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 306 00000100:00100000:1.0:1788863638.028090:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205464704:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 54us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863638.028097:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:0.0:1788863638.028153:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226511616:12345-0@lo:400:kworker.0 Request processed in 162us (8596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863638.028160:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788863638.028195:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226511616:0@lo:400:kworker.0 00000100:00100000:1.0:1788863638.028215:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863638.028310:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205464960 00000100:00100000:1.0:1788863638.028314:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205464960 00000100:00100000:1.0:1788863638.028342:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 153 00000100:00100000:1.0:1788863638.028349:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205464960:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863638.028374:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205464960:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863638.028381:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 153 00000100:00080000:1.0:1788863638.028395:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863638.030588:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863638.031521:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205465088:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 14548us (19138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863638.031538:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:2.0:1788863638.031572:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465216 00000100:00100000:2.0:1788863638.031580:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465216 00000100:00100000:2.0:1788863638.031634:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:2.0:1788863638.031643:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205465216:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863638.031700:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2410:x1875759205465216:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 58us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863638.031707:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00080000:2.0:1788863638.031757:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863638.033581:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205464448:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863638.033664:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205464448:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 5604us (12915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863638.033675:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 306 00000100:00100000:1.0:1788863638.507962:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863638.507985:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226513280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863638.508095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863638.508163:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226513408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863638.508187:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863638.508537:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513280 00000100:00100000:0.0:1788863638.508546:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513280 00000100:00100000:1.0:1788863638.508803:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513408 00000100:00100000:1.0:1788863638.508808:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513408 00000100:00100000:1.0:1788863638.508848:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788863638.508868:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226513408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863638.508922:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863638.508995:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226513408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863638.509003:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863638.509766:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863638.509775:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226513280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863638.509788:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863638.509829:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226513280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863638.509835:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788863638.511101:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544003800 x1875759226513408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863638.511835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226513408:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788863638.511891:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360ed80 x1875759226513280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863638.511906:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226513280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863638.704601:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788863638.898154:0:12207:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:1.0:1788863639.030540:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000001:00100000:0.0:1788863639.030728:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000100:00100000:0.0:1788863639.031581:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226513664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863639.031707:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863639.031796:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863639.031804:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226513536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863639.031826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863639.031881:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513664 00000100:00100000:1.0:1788863639.031887:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513536 00000100:00100000:0.0:1788863639.031890:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513664 00000100:00100000:1.0:1788863639.031898:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513536 00000100:00100000:0.0:1788863639.031951:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863639.031970:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788863639.031970:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226513664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863639.032016:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863639.032066:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226513664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863639.032097:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788863639.032145:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226513664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863639.032446:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226513536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863639.032838:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788863639.032930:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226513536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 949us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863639.032939:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863639.034265:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226513536:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788863639.036149:0:6516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000001:00100000:3.0:1788863639.036689:0:7467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00010000:00010000:1.0:1788863639.723929:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863640.748414:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863641.774288:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863642.604385:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863642.604590:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226513792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863642.604689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863642.604756:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513792 00000100:00100000:1.0:1788863642.604763:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513792 00000100:00100000:1.0:1788863642.604823:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788863642.604834:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226513792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863642.604860:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863642.604911:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226513792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863642.604918:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788863642.604977:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360e680 x1875759226513792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863642.604995:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226513792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863642.605877:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226513920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863642.605936:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788863642.605955:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863642.605992:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226513920 00000100:00100000:1.0:1788863642.605998:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226513920 00000100:00100000:1.0:1788863642.606435:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788863642.606443:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226513920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863642.606460:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863642.606499:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226513920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863642.606505:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788863642.606542:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676154000 x1875759226513920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863642.606558:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226513920:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788863642.608594:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788863642.796877:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863643.116022:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863643.116067:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863643.116132:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863643.116163:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863643.116182:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863643.121050:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863643.122155:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465344 00000100:00100000:0.0:1788863643.122171:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465344 00000100:00100000:0.0:1788863643.122305:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 307 00000100:00100000:0.0:1788863643.122316:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205465344:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863643.122398:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205465344:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 85us (6234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863643.122406:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 307 00000100:00100000:3.0:1788863643.122725:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863643.122752:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465984 00000100:00100000:3.0:1788863643.122757:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465984 00000100:00100000:3.0:1788863643.122810:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205466112 00000100:00100000:3.0:1788863643.122814:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205466112 00000100:00100000:3.0:1788863643.122835:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:3.0:1788863643.122843:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205465984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863643.122882:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205465984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 41us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.122889:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:3.0:1788863643.122902:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:3.0:1788863643.122908:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205466112:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863643.122933:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205466112:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.122938:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00080000:3.0:1788863643.123070:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863643.123091:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863643.123115:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226514048:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.123155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.124553:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226514560:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.124608:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.124642:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226515072:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.124694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.124712:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226515584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.124729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.124751:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863643.124758:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226514176:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.124938:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863643.127099:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465472 00000100:00100000:0.0:1788863643.127114:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465472 00000100:00100000:0.0:1788863643.127251:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465728 00000100:00100000:0.0:1788863643.127255:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465728 00000100:00100000:0.0:1788863643.127277:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465600 00000100:00100000:0.0:1788863643.127279:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465600 00000100:00100000:0.0:1788863643.127292:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205465856 00000100:00100000:0.0:1788863643.127295:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205465856 00000100:00100000:0.0:1788863643.127316:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 154 00000100:00100000:0.0:1788863643.127326:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205465472:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863643.127410:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205465472:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 85us (11400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863643.127417:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 154 00000100:00100000:0.0:1788863643.127434:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 155 00000100:00100000:0.0:1788863643.127452:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205465728:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863643.127478:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205465728:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (11411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863643.127484:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 155 00000100:00100000:0.0:1788863643.127496:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 156 00000100:00100000:0.0:1788863643.127502:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205465600:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863643.127523:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205465600:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 21us (11340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863643.127527:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 156 00000100:00100000:0.0:1788863643.127539:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 157 00000100:00100000:0.0:1788863643.127544:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205465856:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863643.127563:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205465856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 19us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863643.127568:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 157 00000100:00100000:0.0:1788863643.127594:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514048 00000100:00100000:0.0:1788863643.127597:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514048 00000100:00100000:0.0:1788863643.127622:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788863643.127628:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226514048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128599:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226514688:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128646:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.128683:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226515200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128706:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.128740:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226514304:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128777:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.128797:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226514816:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.128831:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226515328:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128853:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.128870:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863643.128876:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226514432:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.128908:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226514944:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128952:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.128971:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226515456:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.128990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863643.129026:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514560 00000100:00100000:3.0:1788863643.129038:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514560 00000100:00100000:3.0:1788863643.129098:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514304 00000100:00100000:3.0:1788863643.129101:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514304 00000100:00100000:3.0:1788863643.129119:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788863643.129127:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226514560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.129176:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226514560:12345-0@lo:400:kworker.0 Request processed in 50us (4568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.129183:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788863643.129377:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514176 00000100:00100000:2.0:1788863643.129381:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514176 00000100:00100000:2.0:1788863643.129404:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514688 00000100:00100000:2.0:1788863643.129408:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514688 00000100:00100000:2.0:1788863643.129419:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515200 00000100:00100000:2.0:1788863643.129423:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515200 00000100:00100000:2.0:1788863643.129434:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514816 00000100:00100000:2.0:1788863643.129437:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514816 00000100:00100000:2.0:1788863643.129446:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515328 00000100:00100000:2.0:1788863643.129448:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515328 00000100:00100000:2.0:1788863643.129459:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514432 00000100:00100000:2.0:1788863643.129461:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514432 00000100:00100000:2.0:1788863643.129472:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788863643.129477:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226514176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863643.129515:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226514176:12345-0@lo:400:kworker.0 Request processed in 37us (4577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863643.129520:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788863643.129537:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788863643.129542:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226514688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863643.129569:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226514688:12345-0@lo:400:kworker.0 Request processed in 27us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863643.129574:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788863643.129585:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788863643.129589:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863643.129613:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226515200:12345-0@lo:400:kworker.0 Request processed in 24us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863643.129627:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788863643.129639:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788863643.129645:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226514816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863643.129693:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226514816:12345-0@lo:400:kworker.0 Request processed in 48us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863643.129698:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788863643.129710:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788863643.129715:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226515328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863643.129743:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226515328:12345-0@lo:400:kworker.0 Request processed in 27us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863643.129747:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788863643.129759:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788863643.129777:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226514432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863643.129803:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226514432:12345-0@lo:400:kworker.0 Request processed in 38us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863643.129809:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788863643.129850:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226514432:0@lo:400:kworker.0 00010000:00080000:2.0:1788863643.129864:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca8380 x1875759226514816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863643.129875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226514816:0@lo:400:kworker.0 00010000:00080000:2.0:1788863643.129886:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d7100 x1875759226515328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863643.129894:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226515328:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130061:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788863643.130069:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226514304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130138:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226514304:12345-0@lo:400:kworker.0 Request processed in 71us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.130144:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788863643.130162:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515072 00000100:00100000:3.0:1788863643.130166:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515072 00000100:00100000:3.0:1788863643.130183:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515584 00000100:00100000:3.0:1788863643.130185:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515584 00000100:00100000:3.0:1788863643.130213:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226514944 00000100:00100000:3.0:1788863643.130216:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226514944 00000100:00100000:3.0:1788863643.130228:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515456 00000100:00100000:3.0:1788863643.130230:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515456 00000100:00100000:3.0:1788863643.130243:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863643.130249:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226515072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130279:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226515072:12345-0@lo:400:kworker.0 Request processed in 30us (5584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.130285:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863643.130296:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788863643.130302:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226515584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130342:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226515584:12345-0@lo:400:kworker.0 Request processed in 41us (5612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.130348:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788863643.130359:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788863643.130365:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226514944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130389:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226514944:12345-0@lo:400:kworker.0 Request processed in 25us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.130394:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788863643.130405:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788863643.130410:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226515456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130435:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226515456:12345-0@lo:400:kworker.0 Request processed in 25us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863643.130440:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788863643.130532:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226514176:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130543:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226514688:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130552:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226515200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.130562:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226514560:0@lo:400:kworker.0 00010000:00080000:3.0:1788863643.130574:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d7b80 x1875759226515072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863643.130582:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226515072:0@lo:400:kworker.0 00010000:00080000:3.0:1788863643.130592:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d6680 x1875759226515584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863643.130600:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226515584:0@lo:400:kworker.0 00010000:00080000:2.0:1788863643.131028:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d4a80 x1875759226514944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863643.131038:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226514944:0@lo:400:kworker.0 00010000:00080000:2.0:1788863643.131048:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d4700 x1875759226515456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863643.131056:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226515456:0@lo:400:kworker.0 00000100:00100000:2.0:1788863643.131065:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226514304:0@lo:400:kworker.0 00000100:00100000:0.0:1788863643.131298:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226514048:12345-0@lo:400:kworker.0 Request processed in 3668us (8140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863643.131307:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1788863643.131349:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863643.131355:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863643.131358:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863643.138429:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226514048:0@lo:400:kworker.0 00000100:00100000:3.0:1788863643.627574:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863643.627608:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226515712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863643.627705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863643.628144:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515712 00000100:00100000:0.0:1788863643.628160:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515712 00000100:00100000:0.0:1788863643.628217:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788863643.628226:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226515712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863643.628257:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863643.628315:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226515712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863643.628322:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788863643.628369:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544001c00 x1875759226515712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863643.628389:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226515712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863643.628471:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863643.628481:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226515840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863643.628510:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863643.628940:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515840 00000100:00100000:1.0:1788863643.628947:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515840 00000100:00100000:1.0:1788863643.628977:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788863643.628985:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226515840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863643.628997:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863643.629050:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226515840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863643.629067:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788863643.629261:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360ed80 x1875759226515840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863643.629276:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226515840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788863643.820543:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863644.142035:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863644.142059:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226515968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863644.142155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863644.142374:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226516096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863644.142404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863644.142443:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226515968 00000100:00100000:2.0:1788863644.142451:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226515968 00000100:00100000:2.0:1788863644.142489:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516096 00000100:00100000:2.0:1788863644.142492:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516096 00000100:00100000:2.0:1788863644.142510:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788863644.142518:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226515968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863644.142552:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863644.142597:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226515968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863644.142604:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788863644.142621:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788863644.142627:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226516096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863644.142642:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863644.142700:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226516096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863644.142723:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788863644.143356:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226515968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863644.143405:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226516096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788863644.847724:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863645.869995:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863646.892949:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788863647.580837:0:12523:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863647.581231:0:12523:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788863647.725293:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863647.725321:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226516224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863647.725415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863647.725506:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516224 00000100:00100000:1.0:1788863647.725516:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516224 00000100:00100000:1.0:1788863647.725601:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788863647.725612:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226516224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863647.725648:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863647.725891:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226516224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 280us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863647.725900:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788863647.725929:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863647.725969:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360c700 x1875759226516224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863647.725992:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226516224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863647.729132:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863647.729164:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226516352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863647.729258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863647.729334:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516352 00000100:00100000:2.0:1788863647.729344:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516352 00000100:00100000:2.0:1788863647.729410:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788863647.729421:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226516352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863647.729450:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863647.729498:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226516352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863647.729505:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788863647.729527:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788863647.729562:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e655c44700 x1875759226516352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863647.729598:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226516352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863647.915380:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863648.237289:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863648.237355:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205466240 00000100:00100000:0.0:1788863648.237371:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205466240 00000100:00100000:0.0:1788863648.237451:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 309 00000100:00100000:0.0:1788863648.237464:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205466240:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863648.237567:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205466240:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.237576:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 309 00000100:00100000:1.0:1788863648.239060:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863648.239111:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863648.239127:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863648.239518:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226516480:0@lo:400:kworker.0 00000100:00100000:2.0:1788863648.239581:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863648.239652:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226516992:0@lo:400:kworker.0 00000100:00100000:2.0:1788863648.239690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863648.239712:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226517504:0@lo:400:kworker.0 00000100:00100000:2.0:1788863648.239736:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863648.239758:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226518016:0@lo:400:kworker.0 00000100:00100000:2.0:1788863648.239795:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863648.240116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863648.240180:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788863648.240190:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226516864:0@lo:400:kworker.0 00000100:00100000:3.0:1788863648.240306:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226516736:0@lo:400:kworker.0 00000100:00100000:3.0:1788863648.240341:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863648.240366:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226517248:0@lo:400:kworker.0 00000100:00100000:3.0:1788863648.240962:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226517504 00000100:00100000:3.0:1788863648.240973:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226517504 00000100:00100000:3.0:1788863648.241024:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518016 00000100:00100000:3.0:1788863648.241028:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518016 00000100:00100000:3.0:1788863648.241059:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788863648.241069:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226517504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863648.241176:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226517504:12345-0@lo:400:kworker.0 Request processed in 108us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863648.241183:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788863648.241200:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788863648.241206:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226518016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863648.241248:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226518016:12345-0@lo:400:kworker.0 Request processed in 42us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863648.241254:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788863648.241272:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516992 00000100:00100000:3.0:1788863648.241276:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516992 00000100:00100000:3.0:1788863648.241298:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516736 00000100:00100000:3.0:1788863648.241301:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516736 00000100:00100000:3.0:1788863648.241311:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788863648.241317:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226516992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863648.241346:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226516992:12345-0@lo:400:kworker.0 Request processed in 29us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863648.241351:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788863648.241362:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788863648.241368:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226516736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863648.241399:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226516736:12345-0@lo:400:kworker.0 Request processed in 32us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863648.241405:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788863648.241458:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863648.242153:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863648.242185:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863648.242249:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205466368 00000100:00100000:0.0:1788863648.242256:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205466368 00000100:00100000:0.0:1788863648.242303:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205466496 00000100:00100000:0.0:1788863648.242306:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205466496 00000100:00100000:0.0:1788863648.242322:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205466624 00000100:00100000:0.0:1788863648.242325:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205466624 00000100:00100000:0.0:1788863648.242338:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205466752 00000100:00100000:0.0:1788863648.242341:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205466752 00000100:00100000:0.0:1788863648.242358:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 164 00000100:00100000:0.0:1788863648.242382:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205466368:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863648.242451:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205466368:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (3396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.242457:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 164 00000100:00100000:0.0:1788863648.242474:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 165 00000100:00100000:0.0:1788863648.242481:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205466496:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863648.242506:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205466496:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.242512:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 165 00000100:00100000:0.0:1788863648.242522:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00100000:0.0:1788863648.242527:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205466624:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863648.242549:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205466624:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (3421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.242554:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00100000:0.0:1788863648.242564:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 167 00000100:00100000:0.0:1788863648.242570:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205466752:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863648.242591:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205466752:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 21us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.242597:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 167 00000100:00100000:0.0:1788863648.242618:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516480 00000100:00100000:0.0:1788863648.242622:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516480 00000100:00100000:0.0:1788863648.242649:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788863648.242654:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226516480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.242706:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226516480:12345-0@lo:400:kworker.0 Request processed in 51us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.242720:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1788863648.242752:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863648.242756:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863648.242948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.242992:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226517760:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243027:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.243102:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226516736:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243120:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788863648.243128:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226516608:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.243162:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226517120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243180:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.243191:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226517632:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.243229:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226517248 00000100:00100000:0.0:1788863648.243233:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226517248 00000100:00100000:0.0:1788863648.243258:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226517760 00000100:00100000:0.0:1788863648.243261:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226517760 00000100:00100000:0.0:1788863648.243271:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516608 00000100:00100000:0.0:1788863648.243274:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516608 00000100:00100000:0.0:1788863648.243284:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226517120 00000100:00100000:0.0:1788863648.243286:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226517120 00000100:00100000:0.0:1788863648.243298:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226517632 00000100:00100000:0.0:1788863648.243300:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226517632 00000100:00100000:0.0:1788863648.243314:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788863648.243320:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226517248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243358:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226517248:12345-0@lo:400:kworker.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.243373:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788863648.243387:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788863648.243392:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226517760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243422:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226517760:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.243427:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788863648.243439:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788863648.243444:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226516608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243470:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226516608:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.243475:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788863648.243486:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788863648.243491:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226517120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243518:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226517120:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.243523:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788863648.243533:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788863648.243539:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226517632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243562:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226517632:12345-0@lo:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.243568:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1788863648.243581:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863648.243584:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863648.243606:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226516608:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243628:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226517120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243636:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226517632:0@lo:400:kworker.0 00010000:00080000:0.0:1788863648.243649:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f480 x1875759226517248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863648.243659:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226517248:0@lo:400:kworker.0 00010000:00080000:0.0:1788863648.243681:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ce00 x1875759226517760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863648.243690:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226517760:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243720:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.243747:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226517376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.243794:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226517888:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863648.243838:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226516480:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243853:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226516992:0@lo:400:kworker.0 00010000:00080000:0.0:1788863648.243865:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f100 x1875759226517504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863648.243873:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226517504:0@lo:400:kworker.0 00010000:00080000:0.0:1788863648.243886:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0df80 x1875759226518016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863648.243895:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226518016:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.243932:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205466880 00000100:00100000:0.0:1788863648.243938:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205466880 00000100:00100000:0.0:1788863648.243969:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467008 00000100:00100000:0.0:1788863648.243972:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467008 00000100:00100000:0.0:1788863648.243987:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226517376 00000100:00100000:0.0:1788863648.243989:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226517376 00000100:00100000:0.0:1788863648.243998:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226517888 00000100:00100000:0.0:1788863648.244001:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226517888 00000100:00100000:0.0:1788863648.244017:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:0.0:1788863648.244024:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205466880:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863648.244070:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205466880:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 48us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.244100:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:0.0:1788863648.244113:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788863648.244120:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205467008:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863648.244144:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205467008:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.244150:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788863648.244160:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863648.244165:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226517376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.244197:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226517376:12345-0@lo:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.244202:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863648.244214:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863648.244220:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226517888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.244245:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226517888:12345-0@lo:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.244258:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788863648.244276:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863648.244279:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863648.244340:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ca80 x1875759226517376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863648.244350:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226517376:0@lo:400:kworker.0 00010000:00080000:0.0:1788863648.244361:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d180 x1875759226517888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863648.244368:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226517888:0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.244385:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226516864 00000100:00100000:0.0:1788863648.244389:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226516864 00000100:00100000:0.0:1788863648.244406:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788863648.244413:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226516864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863648.244449:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226516864:12345-0@lo:400:kworker.0 Request processed in 37us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863648.244455:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788863648.244478:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226516864:0@lo:400:kworker.0 00000100:00100000:1.0:1788863648.752112:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863648.752150:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226518144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863648.752253:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863648.752348:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518144 00000100:00100000:1.0:1788863648.752359:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518144 00000100:00100000:1.0:1788863648.752423:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788863648.752434:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226518144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863648.752486:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863648.752559:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226518144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863648.752567:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1788863648.752620:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543925180 x1875759226518144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863648.752643:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226518144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863648.753031:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863648.753044:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226518272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863648.753116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863648.753317:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518272 00000100:00100000:3.0:1788863648.753324:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518272 00000100:00100000:3.0:1788863648.753365:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788863648.753373:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226518272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863648.753390:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863648.753424:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226518272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863648.753431:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788863648.754349:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7b100 x1875759226518272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863648.754375:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226518272:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863648.939479:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863649.260665:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863649.260707:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226518400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863649.261011:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863649.261066:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226518528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863649.261106:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863649.261159:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518400 00000100:00100000:2.0:1788863649.261171:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518400 00000100:00100000:2.0:1788863649.261259:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788863649.261271:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226518400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863649.261320:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863649.262377:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226518400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1102us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863649.262390:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788863649.262936:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226518400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863649.263213:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863649.264642:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518528 00000100:00100000:0.0:1788863649.264681:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518528 00000100:00100000:0.0:1788863649.264918:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788863649.264930:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226518528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863649.264993:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788863649.265124:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226518528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 188us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863649.265132:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788863649.265194:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226518528:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788863649.969444:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863650.253506:0:12620:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863650.253752:0:12620:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863650.990170:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863652.013259:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863652.463306:0:12718:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863652.463539:0:12718:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788863652.843560:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863652.843594:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226518656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863652.843670:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863652.843757:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226518784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863652.843781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863652.843908:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518656 00000100:00100000:0.0:1788863652.843916:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518656 00000100:00100000:0.0:1788863652.843963:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518784 00000100:00100000:0.0:1788863652.843966:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518784 00000100:00100000:0.0:1788863652.843984:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788863652.843992:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226518656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863652.844024:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863652.844094:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226518656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863652.844101:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788863652.844126:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788863652.844132:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226518784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863652.844142:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863652.844167:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226518784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863652.844172:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788863652.844190:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788863652.844460:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b79f80 x1875759226518784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863652.844481:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226518784:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788863652.844494:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d6680 x1875759226518656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863652.844505:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226518656:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863653.036915:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863653.356359:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226519040:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.356443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863653.356509:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863653.356516:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226518912:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.356545:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863653.356591:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226519296:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.356617:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863653.356637:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863653.356642:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226519168:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.356665:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863653.356696:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519040 00000100:00100000:2.0:1788863653.356706:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519040 00000100:00100000:2.0:1788863653.356758:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519296 00000100:00100000:2.0:1788863653.356761:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519296 00000100:00100000:2.0:1788863653.356785:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788863653.356796:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226519040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.356877:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226519040:12345-0@lo:400:kworker.0 Request processed in 83us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863653.356885:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788863653.356905:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788863653.356911:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226519296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.356941:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226519296:12345-0@lo:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863653.356946:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788863653.356965:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226518912 00000100:00100000:2.0:1788863653.356968:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226518912 00000100:00100000:2.0:1788863653.356993:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788863653.357000:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226518912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.357038:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226518912:12345-0@lo:400:kworker.0 Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863653.357044:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788863653.357501:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226519680:0@lo:400:kworker.0 00000100:00100000:3.0:1788863653.357538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863653.357557:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226520192:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.357709:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519168 00000100:00100000:2.0:1788863653.357715:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519168 00000100:00100000:2.0:1788863653.357748:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863653.357755:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226519168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.357791:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226519168:12345-0@lo:400:kworker.0 Request processed in 37us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863653.357798:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863653.357817:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519680 00000100:00100000:2.0:1788863653.357820:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519680 00000100:00100000:2.0:1788863653.357850:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788863653.357856:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226519680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.357883:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226519680:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863653.357888:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1788863653.357920:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863653.357934:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226519808:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.357960:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863653.357978:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226520320:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.357994:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863653.358025:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226519168:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.358036:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226519296:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.358063:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519808 00000100:00100000:2.0:1788863653.358073:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519808 00000100:00100000:3.0:1788863653.358264:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788863653.358296:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7aa00 x1875759226519680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863653.358307:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226519680:0@lo:400:kworker.0 00000100:00100000:3.0:1788863653.358325:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520192 00000100:00100000:3.0:1788863653.358328:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520192 00000100:00100000:3.0:1788863653.358357:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788863653.358363:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226520192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863653.358398:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226520192:12345-0@lo:400:kworker.0 Request processed in 34us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863653.358404:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788863653.358452:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863653.358472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863653.358490:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863653.358521:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863653.358543:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863653.358561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863653.358597:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00010000:00080000:3.0:1788863653.358621:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7ad80 x1875759226520192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863653.358633:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226520192:0@lo:400:kworker.0 00000100:00100000:3.0:1788863653.358650:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467264 00000100:00100000:3.0:1788863653.358653:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467264 00000100:00100000:3.0:1788863653.358679:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467520 00000100:00100000:3.0:1788863653.358682:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467520 00000100:00100000:3.0:1788863653.358694:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467392 00000100:00100000:3.0:1788863653.358697:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467392 00000100:00100000:3.0:1788863653.358708:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467648 00000100:00100000:3.0:1788863653.358711:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467648 00000100:00100000:3.0:1788863653.358726:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 178 00000100:00100000:3.0:1788863653.358732:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205467264:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863653.358783:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205467264:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863653.358789:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 178 00000100:00100000:3.0:1788863653.358802:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 179 00000100:00100000:3.0:1788863653.358808:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205467520:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863653.358830:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205467520:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863653.358836:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 179 00000100:00100000:3.0:1788863653.358848:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 180 00000100:00100000:3.0:1788863653.358854:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205467392:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863653.358876:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205467392:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863653.358882:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 180 00000100:00100000:3.0:1788863653.358894:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 181 00000100:00100000:3.0:1788863653.358900:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205467648:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863653.358922:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205467648:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863653.358938:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 181 00000100:00100000:1.0:1788863653.360349:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226519424:0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863653.360468:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226519936:0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863653.360506:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226520448:0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360525:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863653.360543:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788863653.360548:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226519552:0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863653.360602:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226520064:0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863653.360653:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519552 00000100:00100000:1.0:1788863653.360660:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519552 00000100:00100000:1.0:1788863653.360698:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520064 00000100:00100000:1.0:1788863653.360700:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520064 00000100:00100000:1.0:1788863653.360718:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788863653.360725:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226519552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360772:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226519552:12345-0@lo:400:kworker.0 Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863653.360779:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788863653.360797:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788863653.360802:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226520064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360826:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226520064:12345-0@lo:400:kworker.0 Request processed in 24us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863653.360831:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788863653.360868:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226519552:0@lo:400:kworker.0 00000100:00100000:1.0:1788863653.360879:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226520064:0@lo:400:kworker.0 00000100:00100000:0.0:1788863653.361130:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520320 00000100:00100000:0.0:1788863653.361135:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520320 00000100:00100000:0.0:1788863653.361180:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467776 00000100:00100000:0.0:1788863653.361184:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467776 00000100:00100000:0.0:1788863653.361200:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467904 00000100:00100000:0.0:1788863653.361203:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467904 00000100:00100000:0.0:1788863653.361233:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519936 00000100:00100000:0.0:1788863653.361236:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519936 00000100:00100000:0.0:1788863653.361247:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520448 00000100:00100000:0.0:1788863653.361249:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520448 00000100:00100000:0.0:1788863653.361263:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863653.361269:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226520320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863653.361317:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226520320:12345-0@lo:400:kworker.0 Request processed in 48us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.361323:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863653.361336:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788863653.361341:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226519936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863653.361373:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226519936:12345-0@lo:400:kworker.0 Request processed in 32us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.361379:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788863653.361388:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788863653.361396:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226520448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863653.361434:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226520448:12345-0@lo:400:kworker.0 Request processed in 40us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.361439:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788863653.361453:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:0.0:1788863653.361459:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2407:x1875759205467776:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:0.0:1788863653.361479:0:8450:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68e34 00000100:00080000:0.0:1788863653.361488:0:8450:0:(import.c:65:import_set_state_nolock()) ffff89e67c4ce800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863653.361533:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788863653.361691:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+2:2407:x1875759205467776:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 232us (3218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.361698:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:0.0:1788863653.361711:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:0.0:1788863653.361717:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2407:x1875759205467904:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:0.0:1788863653.361727:0:8450:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68e3b 00000100:00080000:0.0:1788863653.361733:0:8450:0:(import.c:65:import_set_state_nolock()) ffff89e67c4cd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863653.361755:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788863653.361824:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+2:2407:x1875759205467904:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 107us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.361830:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:0.0:1788863653.361856:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205467136 00000100:00100000:0.0:1788863653.361860:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205467136 00000100:00100000:0.0:1788863653.361888:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 312 00000100:00100000:0.0:1788863653.361894:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205467136:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863653.361919:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205467136:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.361934:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 312 00010000:00010000:0.0:1788863653.362142:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863653.362149:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788863653.362180:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7b480 x1875759226520320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863653.362195:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226520320:0@lo:400:kworker.0 00010000:00080000:0.0:1788863653.362231:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b78a80 x1875759226519936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863653.362241:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226519936:0@lo:400:kworker.0 00010000:00080000:0.0:1788863653.362252:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7a680 x1875759226520448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863653.362260:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226520448:0@lo:400:kworker.0 00000100:00080000:2.0:1788863653.362474:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863653.362478:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863653.362481:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863653.362484:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863653.362497:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226519424 00000100:00100000:2.0:1788863653.362501:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226519424 00000100:00100000:2.0:1788863653.362530:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788863653.362537:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226519424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.362603:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226519424:12345-0@lo:400:kworker.0 Request processed in 66us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863653.362610:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788863653.362647:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226518912:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.362665:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226519040:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.362716:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863653.362723:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226519808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.362758:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226519808:12345-0@lo:400:kworker.0 Request processed in 36us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863653.362764:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788863653.365326:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7b800 x1875759226519808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863653.365349:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226519808:0@lo:400:kworker.0 00000100:00100000:0.0:1788863653.365396:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226519424:0@lo:400:kworker.0 00000100:00100000:2.0:1788863653.867409:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226520576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863653.867490:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863653.867675:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226520704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863653.869412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863653.875058:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520576 00000100:00100000:0.0:1788863653.875072:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520576 00000100:00100000:0.0:1788863653.875224:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520704 00000100:00100000:0.0:1788863653.875228:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520704 00000100:00100000:0.0:1788863653.875247:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863653.875256:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226520576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863653.875292:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863653.875397:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226520576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (7907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.875404:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863653.875422:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788863653.875429:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226520704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863653.875440:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863653.875473:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226520704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (6067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863653.875479:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788863653.875526:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543925c00 x1875759226520704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863653.875546:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226520704:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788863653.876241:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360ed80 x1875759226520576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863653.876261:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226520576:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788863654.062104:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863654.382635:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226520832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863654.382740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863654.382866:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520832 00000100:00100000:0.0:1788863654.382877:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520832 00000100:00100000:0.0:1788863654.382940:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788863654.382950:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226520832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863654.382994:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788863654.383051:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226520832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863654.383058:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788863654.383148:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226520832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863654.384114:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226520960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863654.384177:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863654.384312:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226520960 00000100:00100000:1.0:1788863654.384321:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226520960 00000100:00100000:1.0:1788863654.384379:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788863654.384388:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226520960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863654.384426:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863654.384491:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226520960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863654.384497:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788863654.384731:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226520960:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788863654.921237:0:12815:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863654.922466:0:12815:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863655.083245:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863656.107374:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788863657.106453:0:12912:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788863657.106683:0:12912:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788863657.132203:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863657.963628:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863657.963648:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226521216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863657.963648:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226521088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863657.965861:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863657.966100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863657.966234:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521088 00000100:00100000:0.0:1788863657.966244:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521088 00000100:00100000:0.0:1788863657.966296:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521216 00000100:00100000:0.0:1788863657.966299:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521216 00000100:00100000:0.0:1788863657.966316:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788863657.966326:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226521088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863657.966360:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863657.966408:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226521088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863657.966415:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788863657.966430:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788863657.966436:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226521216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863657.966445:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863657.966468:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226521216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863657.966487:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788863657.966624:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863657.966658:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544061f80 x1875759226521216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863657.966677:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226521216:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788863657.966862:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca9c00 x1875759226521088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863657.966875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226521088:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788863658.156467:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863658.476944:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863658.476994:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863658.477015:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863658.477030:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863658.477051:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863658.479210:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468032 00000100:00100000:1.0:1788863658.479226:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468032 00000100:00100000:1.0:1788863658.479301:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 313 00000100:00100000:1.0:1788863658.479311:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205468032:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863658.479402:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205468032:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 92us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.479409:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 313 00000100:00100000:1.0:1788863658.479457:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468288 00000100:00100000:1.0:1788863658.479461:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468288 00000100:00100000:1.0:1788863658.479511:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468544 00000100:00100000:1.0:1788863658.479514:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468544 00000100:00100000:1.0:1788863658.479527:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468160 00000100:00100000:1.0:1788863658.479529:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468160 00000100:00100000:1.0:1788863658.479543:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468416 00000100:00100000:1.0:1788863658.479546:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468416 00000100:00100000:1.0:1788863658.479564:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 184 00000100:00100000:1.0:1788863658.479573:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205468288:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863658.479581:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00100000:2.0:1788863658.479594:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205468544:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863658.479625:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205468288:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.479632:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 184 00000100:00100000:2.0:1788863658.479642:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205468544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 51us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.479649:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:1.0:1788863658.479657:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205468160:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863658.479684:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205468160:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863658.479985:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226521344:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480127:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226521856:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480185:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226522368:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480233:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788863658.480238:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226521728:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480259:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480282:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226522240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480321:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226521600:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480361:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226522112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480391:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226522624:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480428:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788863658.480432:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226521472:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480459:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226521984:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480490:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480499:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226522496:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480515:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863658.480541:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521344 00000100:00100000:0.0:1788863658.480546:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521344 00000100:00100000:0.0:1788863658.480580:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788863658.480657:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226521344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480773:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226521344:12345-0@lo:400:kworker.0 Request processed in 119us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863658.480780:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788863658.480810:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521856 00000100:00100000:0.0:1788863658.480814:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521856 00000100:00100000:0.0:1788863658.480837:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521600 00000100:00100000:0.0:1788863658.480839:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521600 00000100:00100000:0.0:1788863658.480864:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863658.480869:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226521856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480901:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226521856:12345-0@lo:400:kworker.0 Request processed in 32us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863658.480906:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863658.480918:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788863658.480923:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226521600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.480954:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226521600:12345-0@lo:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863658.480960:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788863658.480979:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226522624 00000100:00100000:0.0:1788863658.480982:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226522624 00000100:00100000:0.0:1788863658.481010:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226522496 00000100:00100000:0.0:1788863658.481012:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226522496 00000100:00100000:0.0:1788863658.481031:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788863658.481038:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226522624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.481170:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226522624:12345-0@lo:400:kworker.0 Request processed in 133us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863658.481177:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788863658.481190:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788863658.481290:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226522496:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788863658.481376:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863658.481381:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863658.481383:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863658.481431:0:6538:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788863658.481444:0:6538:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788863658.481480:0:6537:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788863658.481488:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226522368 00000100:00100000:3.0:1788863658.481492:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226522368 00000100:00100000:0.0:1788863658.481548:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226522496:12345-0@lo:400:kworker.0 Request processed in 353us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863658.481555:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788863658.481677:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0dc00 x1875759226522496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863658.481704:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226522496:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.481720:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226521600:0@lo:400:kworker.0 00010000:00080000:0.0:1788863658.481729:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0c700 x1875759226522624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863658.481736:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226522624:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.481767:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226521344:0@lo:400:kworker.0 00000100:00100000:0.0:1788863658.481776:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226521856:0@lo:400:kworker.0 00000100:00100000:2.0:1788863658.483526:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00100000:1.0:1788863658.483564:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:1.0:1788863658.483615:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521728 00000100:00100000:1.0:1788863658.483623:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521728 00000100:00100000:1.0:1788863658.483659:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226522240 00000100:00100000:1.0:1788863658.483662:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226522240 00000100:00100000:1.0:1788863658.483777:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226522112 00000100:00100000:1.0:1788863658.483781:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226522112 00000100:00100000:1.0:1788863658.483802:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521472 00000100:00100000:1.0:1788863658.483805:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521472 00000100:00100000:1.0:1788863658.483817:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226521984 00000100:00100000:1.0:1788863658.483820:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226521984 00000100:00100000:1.0:1788863658.483836:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 187 00000100:00100000:1.0:1788863658.483846:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205468416:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863658.484241:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205468416:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 394us (7186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.484250:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 187 00000100:00100000:1.0:1788863658.484268:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788863658.484276:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226521728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.484344:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226521728:12345-0@lo:400:kworker.0 Request processed in 70us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.484369:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788863658.484383:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788863658.484389:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226522240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.484426:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226522240:12345-0@lo:400:kworker.0 Request processed in 38us (4123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.484432:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788863658.484443:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788863658.484448:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226522112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.484495:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226522112:12345-0@lo:400:kworker.0 Request processed in 47us (4114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.484501:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788863658.484513:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788863658.484519:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226521472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.484549:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226521472:12345-0@lo:400:kworker.0 Request processed in 30us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.484556:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788863658.484567:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788863658.484573:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226521984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.484601:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226521984:12345-0@lo:400:kworker.0 Request processed in 28us (4110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.484607:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788863658.484652:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226521728:0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.484665:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226522240:0@lo:400:kworker.0 00000100:00080000:2.0:1788863658.485229:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863658.485236:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863658.485511:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226521472:0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.485525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226521984:0@lo:400:kworker.0 00010000:00080000:1.0:1788863658.485538:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d500 x1875759226522112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863658.485549:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226522112:0@lo:400:kworker.0 00000100:00100000:3.0:1788863658.487700:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788863658.487722:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226522368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863658.487844:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226522368:12345-0@lo:400:kworker.0 Request processed in 133us (7632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863658.487852:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:2.0:1788863658.487955:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f480 x1875759226522368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863658.487972:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226522368:0@lo:400:kworker.0 00000100:00100000:1.0:1788863658.988392:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863658.988418:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226522752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863658.988500:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863658.988579:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226522752 00000100:00100000:1.0:1788863658.988588:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226522752 00000100:00100000:1.0:1788863658.988645:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788863658.988655:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226522752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863658.988686:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863658.988732:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226522752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.988739:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1788863658.988779:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543925880 x1875759226522752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863658.988798:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226522752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863658.992373:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863658.992393:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226522880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863658.992473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863658.992538:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226522880 00000100:00100000:1.0:1788863658.992547:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226522880 00000100:00100000:1.0:1788863658.992606:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788863658.992615:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226522880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863658.993419:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863658.993505:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226522880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 889us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863658.993515:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788863658.993571:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543925880 x1875759226522880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863658.993595:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226522880:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788863658.994777:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000020:00000080:0.0:1788863658.994784:0:8444:0:(genops.c:885:class_export_put()) final put ffff89e67c4ce000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000020:00000080:2.0:1788863658.995355:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67c4ce000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d for lustre-OST0000 00000020:00000080:2.0:1788863658.995401:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67c4ce800 for lustre-OST0000 00000001:00100000:0.0:1788863659.001054:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000020:00000080:0.0:1788863659.001063:0:9530:0:(genops.c:885:class_export_put()) final put ffff89e67c4c8000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000020:00000080:2.0:1788863659.006426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67c4c8000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d for lustre-OST0001 00000020:00000080:2.0:1788863659.006521:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67c4cd000 for lustre-OST0001 00010000:00010000:0.0:1788863659.180446:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863659.500212:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863659.500242:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226523008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863659.500315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863659.500405:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226523136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863659.500429:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863659.500818:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523008 00000100:00100000:0.0:1788863659.500828:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523008 00000100:00100000:0.0:1788863659.500892:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523136 00000100:00100000:0.0:1788863659.500896:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523136 00000100:00100000:0.0:1788863659.500916:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788863659.500925:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226523008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863659.500949:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788863659.500962:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226523136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863659.500964:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:3.0:1788863659.500987:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788863659.501034:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226523008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863659.501041:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226523136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863659.501046:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788863659.501055:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788863659.501525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226523136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863659.501540:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226523008:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788863660.204868:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863661.239397:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788863661.419558:0:13058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788863662.251494:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863663.084644:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863663.084668:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226523264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863663.084752:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863663.093166:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863663.093198:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226523392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863663.093290:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863663.096825:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523264 00000100:00100000:2.0:1788863663.096847:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523264 00000100:00100000:2.0:1788863663.096902:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523392 00000100:00100000:2.0:1788863663.096906:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523392 00000100:00100000:2.0:1788863663.096928:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788863663.096937:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226523264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863663.096971:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788863663.097404:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863663.100202:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226523264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3257us (15441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.100298:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788863663.100343:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788863663.100356:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226523392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863663.100394:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863663.100447:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226523392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (7156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.100463:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788863663.100511:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca9c00 x1875759226523392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863663.100534:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226523392:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788863663.101127:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544062300 x1875759226523264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863663.101155:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226523264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863663.275623:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863663.595481:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226523520:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595566:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595620:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226524032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595658:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226524544:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595700:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863663.595705:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226523648:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595721:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595732:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226524160:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595748:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595760:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226524672:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595779:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595800:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226523776:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595818:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595829:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226524288:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595844:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595854:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226524800:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.595899:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788863663.595904:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.595921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863663.596025:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523520 00000100:00100000:0.0:1788863663.596033:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523520 00000100:00100000:0.0:1788863663.596096:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788863663.596105:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226523520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863663.596402:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524544 00000100:00100000:2.0:1788863663.596406:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524544 00000100:00100000:2.0:1788863663.596445:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523648 00000100:00100000:2.0:1788863663.596448:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523648 00000100:00100000:2.0:1788863663.596459:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524160 00000100:00100000:2.0:1788863663.596461:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524160 00000100:00100000:2.0:1788863663.596471:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524288 00000100:00100000:2.0:1788863663.596474:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524288 00000100:00100000:2.0:1788863663.596485:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523904 00000100:00100000:2.0:1788863663.596487:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523904 00000100:00100000:2.0:1788863663.596499:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788863663.596505:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226524544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863663.596790:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788863663.596799:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226523648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863663.599439:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226524544:12345-0@lo:400:kworker.0 Request processed in 2920us (3745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863663.599459:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788863663.599501:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788863663.599514:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226524160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863663.599565:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226524160:12345-0@lo:400:kworker.0 Request processed in 57us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863663.599570:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788863663.599582:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788863663.599588:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226524288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863663.599616:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226524288:12345-0@lo:400:kworker.0 Request processed in 29us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863663.599622:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788863663.599649:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788863663.599655:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226523904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863663.599687:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226523904:12345-0@lo:400:kworker.0 Request processed in 32us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863663.599693:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1788863663.599740:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863663.599745:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863663.599782:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226524160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863663.599856:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226523520:12345-0@lo:400:kworker.0 Request processed in 3752us (4289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863663.599865:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788863663.599911:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524032 00000100:00100000:0.0:1788863663.599919:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524032 00000100:00100000:0.0:1788863663.599970:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226523776 00000100:00100000:0.0:1788863663.599973:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226523776 00000100:00100000:0.0:1788863663.599987:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863663.599992:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226524032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863663.600027:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226524032:12345-0@lo:400:kworker.0 Request processed in 34us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863663.600033:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863663.600044:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788863663.600050:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226523776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863663.600097:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226523776:12345-0@lo:400:kworker.0 Request processed in 48us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863663.600103:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788863663.600136:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524672 00000100:00100000:0.0:1788863663.600148:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524672 00000100:00100000:0.0:1788863663.600186:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524800 00000100:00100000:0.0:1788863663.600190:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524800 00000100:00100000:0.0:1788863663.600208:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788863663.600213:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226524672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863663.600248:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226524672:12345-0@lo:400:kworker.0 Request processed in 35us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863663.600254:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788863663.600266:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788863663.600272:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226524800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863663.600301:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226524800:12345-0@lo:400:kworker.0 Request processed in 29us (4428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863663.600306:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788863663.600336:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863663.604628:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.604644:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.604716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863663.604762:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226523776:0@lo:400:kworker.0 00010000:00080000:3.0:1788863663.604780:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f800 x1875759226524288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863663.604791:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226524288:0@lo:400:kworker.0 00010000:00080000:3.0:1788863663.604803:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0c700 x1875759226524800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863663.604810:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226524800:0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.604871:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524416 00000100:00100000:3.0:1788863663.604879:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524416 00000100:00100000:3.0:1788863663.604967:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788863663.604979:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226524416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863663.605034:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226524416:12345-0@lo:400:kworker.0 Request processed in 58us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.605041:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788863663.605146:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863663.605171:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863663.605191:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863663.605207:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863663.605246:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00080000:3.0:1788863663.605258:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863663.605268:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468928 00000100:00100000:3.0:1788863663.605272:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468928 00000100:00100000:3.0:1788863663.605294:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469184 00000100:00100000:3.0:1788863663.605297:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469184 00000100:00100000:3.0:1788863663.605308:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468800 00000100:00100000:3.0:1788863663.605310:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468800 00000100:00100000:3.0:1788863663.605320:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469056 00000100:00100000:3.0:1788863663.605322:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469056 00000100:00100000:3.0:1788863663.605337:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 200 00000100:00100000:3.0:1788863663.605343:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205468928:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863663.605402:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205468928:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 58us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.605408:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 200 00000100:00100000:3.0:1788863663.605420:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 201 00000100:00100000:3.0:1788863663.605427:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205469184:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863663.605449:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205469184:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 24us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.605455:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 201 00000100:00100000:3.0:1788863663.605466:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 202 00000100:00100000:3.0:1788863663.605472:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205468800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863663.605499:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205468800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.605503:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 202 00000100:00100000:3.0:1788863663.605515:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 203 00000100:00100000:3.0:1788863663.605520:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205469056:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863663.605555:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205469056:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 34us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.605560:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 203 00000100:00100000:3.0:1788863663.605582:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205468672 00000100:00100000:3.0:1788863663.605586:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205468672 00000100:00100000:3.0:1788863663.605612:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 316 00000100:00100000:3.0:1788863663.605618:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205468672:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863663.605641:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205468672:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863663.605647:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 316 00000100:00080000:3.0:1788863663.605813:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863663.605817:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863663.605847:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226524416:0@lo:400:kworker.0 00000100:00100000:1.0:1788863663.606971:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226523648:12345-0@lo:400:kworker.0 Request processed in 10168us (11243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863663.606984:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788863663.612288:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226523520:0@lo:400:kworker.0 00000100:00100000:2.0:1788863663.612333:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226524032:0@lo:400:kworker.0 00010000:00080000:2.0:1788863663.612349:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ca80 x1875759226524544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863663.612360:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226524544:0@lo:400:kworker.0 00000100:00100000:2.0:1788863663.612410:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226523648:0@lo:400:kworker.0 00010000:00080000:2.0:1788863663.612422:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0df80 x1875759226524672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863663.612431:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226524672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863664.110554:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226524928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863664.110627:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863664.110819:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226524928 00000100:00100000:3.0:1788863664.110828:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226524928 00000100:00100000:3.0:1788863664.110881:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863664.110891:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226524928:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863664.111336:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226525056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863664.111391:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788863664.111544:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863664.111605:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226524928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 713us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863664.111612:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863664.111633:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226525056 00000100:00100000:3.0:1788863664.111637:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226525056 00000100:00100000:3.0:1788863664.111654:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863664.111660:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226525056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863664.111675:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863664.111717:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226525056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863664.111724:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788863664.111757:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca8380 x1875759226525056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863664.111777:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226525056:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788863664.111804:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d180 x1875759226524928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863664.111817:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226524928:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788863664.299605:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863664.620194:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226525312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863664.620206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226525184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863664.630989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863664.631135:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226525312 00000100:00100000:3.0:1788863664.631147:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226525312 00000100:00100000:3.0:1788863664.631206:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788863664.631215:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226525312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863664.631259:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788863664.631308:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226525312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863664.631316:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788863664.631400:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226525312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863664.636196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863664.637584:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226525184 00000100:00100000:1.0:1788863664.637613:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226525184 00000100:00100000:1.0:1788863664.637679:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788863664.637690:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226525184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863664.637734:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863664.637813:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226525184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863664.637821:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788863664.637878:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226525184:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788863665.323302:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788863665.857698:0:13206:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe84b94a30 20000000:00000080:1.0:1788863665.857719:0:13206:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e542ae3000 uarg=0000000000000000 20000000:01000000:1.0:1788863665.857761:0:13206:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788863665.857768:0:13206:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788863665.857772:0:13206:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788863665.858330:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788863665.858538:0:13206:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788863665.868170:0:13206:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788863665.868219:0:13206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868241:0:13206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868250:0:13206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868257:0:13206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868263:0:13206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868297:0:13206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868478:0:13206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868489:0:13206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868539:0:13206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868555:0:13206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 12 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.868572:0:13206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525440:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863665.868691:0:13206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868700:0:13206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 12 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.868708:0:13206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525568:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863665.868738:0:13206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.868746:0:13206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 23 pid: 6529 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.868768:0:13206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525696:0@lo:104: 00000100:00100000:1.0:1788863665.868809:0:13206:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863665.869134:0:13206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.869144:0:13206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 23 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.869153:0:13206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525824:0@lo:104: 00000100:00100000:1.0:1788863665.869177:0:13206:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863665.870837:0:13206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.870857:0:13206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 23 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.870871:0:13206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525952:0@lo:104: 00000100:00100000:1.0:1788863665.870916:0:13206:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863665.871708:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226525696 00000100:00100000:3.0:1788863665.871720:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226525696 00000100:00100000:3.0:1788863665.871785:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226525824 00000100:00100000:3.0:1788863665.871789:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226525824 00000100:00100000:3.0:1788863665.871808:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863665.871815:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:13206:x1875759226525696:12345-0@lo:104: 00010000:00010000:3.0:1788863665.871840:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.871900:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863665.871906:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:13206:x1875759226525696:12345-0@lo:104: Request processed in 92us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.871913:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863665.871935:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863665.871941:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13206:x1875759226525824:12345-0@lo:104: 00010000:00010000:3.0:1788863665.871947:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.871977:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788863665.871982:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13206:x1875759226525824:12345-0@lo:104: Request processed in 41us (2805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.871987:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788863665.872185:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863665.872191:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872199:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863665.872203:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872276:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863665.872283:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863665.872297:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863665.872415:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872422:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863665.872443:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872450:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d99c00/0xf569beb9d4b68dfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e03 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872465:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863665.872468:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872473:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863665.872476:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872483:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863665.872488:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863665.872494:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863665.872505:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872510:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863665.872530:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872537:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d90200/0xf569beb9d4b68dee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68df5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872545:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863665.872547:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863665.872549:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863665.872567:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226526080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863665.872602:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863665.872650:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226526208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863665.872683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863665.872715:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526080 00000100:00100000:3.0:1788863665.872720:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526080 00010000:00010000:3.0:1788863665.872738:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 24 pid: 6529 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863665.872755:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526208 00000100:00100000:3.0:1788863665.872757:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526208 00010000:00010000:3.0:1788863665.872766:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 25 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863665.872781:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788863665.872786:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3643:x1875759226526080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863665.872797:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863665.872802:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 25 pid: 6529 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872811:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 25 pid: 6529 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872835:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863665.872862:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3643:x1875759226526080:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.872869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788863665.872883:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863665.872887:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226526208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863665.872894:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863665.872898:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 24 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872906:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 24 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.872914:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863665.872934:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226526208:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.872939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863665.872974:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226526208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863665.872996:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226526080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863665.873303:0:13206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863665.873463:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226525952 00000100:00100000:3.0:1788863665.873470:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226525952 00000100:00100000:3.0:1788863665.873496:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863665.873502:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13206:x1875759226525952:12345-0@lo:104: 00010000:00010000:3.0:1788863665.873512:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.873577:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863665.873582:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13206:x1875759226525952:12345-0@lo:104: Request processed in 81us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.873589:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1788863665.873639:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863665.873646:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.873659:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863665.873663:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.873670:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863665.873676:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863665.873681:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788863665.873715:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.873720:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863665.873737:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.873744:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d91a00/0xf569beb9d4b68de0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68de7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.873756:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863665.873758:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863665.873759:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863665.873771:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226526464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863665.873801:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863665.873832:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526464 00000100:00100000:2.0:1788863665.873836:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526464 00010000:00010000:2.0:1788863665.873852:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 24 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863665.873896:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863665.873903:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226526464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863665.873911:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863665.873916:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 24 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.873952:0:13206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 24 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.873963:0:13206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226526336:0@lo:104: 00000100:00100000:1.0:1788863665.873991:0:13206:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863665.874006:0:13206:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863665.874037:0:13206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525440:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863665.874058:0:13206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525568:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863665.874068:0:13206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d400/0xf569beb9d4b68e03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68dfc expref: 24 pid: 6529 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.874110:0:13206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525696:0@lo:104: 00010000:00010000:1.0:1788863665.874121:0:13206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114600/0xf569beb9d4b68df5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68dee expref: 23 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863665.874131:0:13206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525824:0@lo:104: 00000100:00100000:1.0:1788863665.874138:0:13206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226525952:0@lo:104: 00000100:00100000:3.0:1788863665.874822:0:7487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526336 00000100:00100000:3.0:1788863665.874829:0:7487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526336 00000100:00100000:3.0:1788863665.874859:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788863665.874865:0:7487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13206:x1875759226526336:12345-0@lo:104: 00010000:00010000:3.0:1788863665.874878:0:7487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.874933:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863665.874939:0:7487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13206:x1875759226526336:12345-0@lo:104: Request processed in 74us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.874945:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788863665.874967:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863665.874972:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.874978:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863665.874982:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.874989:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863665.874995:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863665.875025:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863665.875052:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.875058:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863665.875072:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.875099:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114a00/0xf569beb9d4b68dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68dd9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.875115:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863665.875116:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863665.875118:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863665.875130:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226526592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863665.875159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863665.875202:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526592 00000100:00100000:3.0:1788863665.875216:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526592 00010000:00010000:3.0:1788863665.875231:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 23 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863665.875253:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863665.875259:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:3642:x1875759226526592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863665.875269:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863665.875274:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 23 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.875644:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863665.875831:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863665.875870:0:13206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13206:1875759226526336:0@lo:104: 00000100:00100000:0.0:1788863665.875940:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469312 00000100:00100000:0.0:1788863665.875944:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469312 00010000:00010000:0.0:1788863665.875964:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 13 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863665.875980:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:0.0:1788863665.875988:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205469312:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863665.875997:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863665.876002:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 13 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.876377:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 23 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.876395:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b68de7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68de0 expref: 23 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863665.876408:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863665.876450:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3641:x1875759226526464:12345-0@lo:103:ldlm_bl.0 Request processed in 2548us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863665.876458:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863665.876494:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226526464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863665.876736:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 21 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.876756:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98600/0xf569beb9d4b68dd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68dd2 expref: 21 pid: 6532 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.876766:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863665.876800:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:3642:x1875759226526592:12345-0@lo:103:ldlm_bl.0 Request processed in 1541us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.876806:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863665.876847:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226526592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863665.876934:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863665.876988:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469440 00000100:00100000:3.0:1788863665.876992:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469440 00010000:00010000:3.0:1788863665.877023:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 14 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863665.877052:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:3.0:1788863665.877059:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e448c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed3e4520-177d-4764-9911-f67f7853934a+14:2408:x1875759205469440:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863665.877068:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863665.877096:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 14 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.877106:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 14 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.877118:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d90e00/0xf569beb9d4b68e0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dc3 expref: 14 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863665.877127:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863665.877168:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e448c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205469440:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863665.877182:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00010000:00010000:1.0:1788863665.877778:0:13206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877855:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 12 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877869:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167da00/0xf569beb9d4b68e1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e02 expref: 12 pid: 6530 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877883:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877892:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877912:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877920:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877928:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877935:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877941:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650115400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863665.877946:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.877955:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.878288:0:13206:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863665.878296:0:13206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.879185:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.879202:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115400/0xf569beb9d4b68e42 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863665.879292:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863665.879708:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed3e4520-177d-4764-9911-f67f7853934a+11:2409:x1875759205469312:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 3711us (3870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863665.879720:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00010000:00010000:2.0:1788863666.347478:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863667.372167:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788863667.819306:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863667.819314:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67aeee000 from 7 10000000:01000000:0.0:1788863667.819320:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863667.819378:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.819390:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.819402:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863667.819432:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226526720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.819509:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863667.819601:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863667.819842:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526720 00000100:00100000:1.0:1788863667.819852:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526720 00000100:00100000:1.0:1788863667.819964:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788863667.819974:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226526720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863667.819988:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863667.820003:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68e49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.820045:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.820055:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.820064:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114600, rc 0) 00000100:00100000:1.0:1788863667.820136:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226526720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.820142:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788863667.821975:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226526720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863667.822002:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863667.822014:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863667.822157:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226526848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.822229:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863667.822286:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642eb5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863667.822378:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526848 00000100:00100000:0.0:1788863667.822386:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526848 00000100:00100000:0.0:1788863667.822492:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788863667.822504:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226526848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.822688:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226526848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863667.822695:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788863667.822769:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226526848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.822809:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226526976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.822846:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863667.827340:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642eb5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863667.827786:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226526976 00000100:00100000:1.0:1788863667.827798:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226526976 00000100:00100000:1.0:1788863667.827858:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788863667.827867:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226526976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863667.828759:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226526976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 888us (5907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.828770:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788863667.830718:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226526976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788863667.832042:0:13263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788863667.832689:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788863667.832713:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863667.832725:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.832738:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863667.832749:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863667.832751:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67afa4000 from 7 10000000:01000000:0.0:1788863667.832754:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863667.832795:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.832803:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.832814:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863667.832840:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.832907:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863667.832955:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788863667.833771:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226527104 00000100:00100000:2.0:1788863667.833782:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226527104 00000100:00100000:1.0:1788863667.833969:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788863667.833978:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226527104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863667.833994:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863667.834010:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68e57 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.834034:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.834060:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.834068:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114a00, rc 0) 00000100:00100000:1.0:1788863667.834152:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226527104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.834160:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788863667.834295:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863667.834312:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863667.834321:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863667.834387:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.834416:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863667.834452:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6488e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863667.834546:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226527232 00000100:00100000:1.0:1788863667.834551:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226527232 00000100:00100000:1.0:1788863667.834582:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788863667.834598:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226527232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863667.834708:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226527232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.834715:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788863667.834771:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.834802:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.834843:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863667.834864:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6488e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863667.834891:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226527360 00000100:00100000:0.0:1788863667.834903:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226527360 00000100:00100000:0.0:1788863667.834936:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788863667.834943:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226527360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.835045:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226527360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863667.835052:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788863667.835128:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788863667.836398:0:13264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788863667.838207:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788863667.838240:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863667.838253:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.838267:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863667.839983:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788863667.839992:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e648f4b800 from 7 10000000:01000000:1.0:1788863667.839998:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863667.840056:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.840067:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.840098:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863667.840128:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863667.840211:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863667.840263:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788863667.841641:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226527488 00000100:00100000:0.0:1788863667.841653:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226527488 00000100:00100000:0.0:1788863667.841721:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788863667.841731:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226527488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863667.841748:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863667.841777:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68e65 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.841813:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.841824:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.841833:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90200, rc 0) 00000100:00100000:0.0:1788863667.841913:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226527488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863667.841920:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788863667.842145:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863667.842168:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863667.842177:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863667.842329:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.842360:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863667.842390:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863667.842500:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226527616 00000100:00100000:1.0:1788863667.842505:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226527616 00000100:00100000:1.0:1788863667.842545:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788863667.842553:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226527616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863667.842676:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226527616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.842683:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788863667.842801:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.842831:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.842870:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863667.842889:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863667.842902:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226527744 00000100:00100000:2.0:1788863667.842905:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226527744 00000100:00100000:2.0:1788863667.842923:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788863667.842929:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226527744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.843001:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226527744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863667.843008:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788863667.843043:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788863667.845650:0:13265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788863667.846025:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788863667.846103:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863667.846116:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.846128:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863667.846140:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863667.846142:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e64a89a800 from 7 10000000:01000000:0.0:1788863667.846145:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863667.846187:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.846195:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.846205:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863667.846243:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.846328:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863667.846377:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788863667.846701:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226527872 00000100:00100000:1.0:1788863667.846709:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226527872 00000100:00100000:1.0:1788863667.846752:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788863667.846761:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226527872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863667.846776:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863667.846790:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68e73 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.846814:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.846824:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.846833:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114c00, rc 0) 00000100:00100000:1.0:1788863667.846875:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226527872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.846881:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788863667.847465:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226527872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863667.847484:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863667.847507:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863667.847579:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226528000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.847805:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863667.847846:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429cb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788863667.847955:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528000 00000100:00100000:1.0:1788863667.847961:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528000 00000100:00100000:1.0:1788863667.847999:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788863667.848007:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226528000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863667.848152:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226528000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.848161:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788863667.848167:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226528000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.848208:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226528128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.848260:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863667.848339:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528128 00000100:00100000:1.0:1788863667.848344:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528128 00000100:00100000:1.0:1788863667.848377:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788863667.848384:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226528128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863667.848838:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863667.855806:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226528128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7411us (7534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.855824:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788863667.856624:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226528128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788863667.857830:0:13266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788863667.858137:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788863667.858179:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863667.858191:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863667.858203:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863667.888246:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863667.888328:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469568 00000100:00100000:1.0:1788863667.888338:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469568 00000100:00100000:1.0:1788863667.888385:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 329 00000100:00100000:1.0:1788863667.888394:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+11:6188:x1875759205469568:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863667.888411:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863667.888442:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e33 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.888484:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.888496:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.888515:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f000, rc 0) 00000100:00100000:1.0:1788863667.888582:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205469568:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 185us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.888597:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 329 00000100:00100000:2.0:1788863667.898298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863667.898417:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469696 00000100:00100000:1.0:1788863667.898428:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469696 00000100:00100000:1.0:1788863667.898495:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 330 00000100:00100000:1.0:1788863667.898506:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205469696:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863667.898849:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205469696:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 343us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.898859:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 330 00000100:00100000:3.0:1788863667.901402:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863667.903010:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469824 00000100:00100000:1.0:1788863667.903024:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469824 00000100:00100000:1.0:1788863667.903115:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 331 00000100:00100000:1.0:1788863667.903127:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205469824:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863667.903292:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205469824:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 167us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.903301:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 331 00000100:00100000:2.0:1788863667.915601:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863667.915692:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205469952 00000100:00100000:1.0:1788863667.915709:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205469952 00000100:00100000:1.0:1788863667.915777:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 332 00000100:00100000:1.0:1788863667.915788:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205469952:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863667.915807:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863667.915827:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e3a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.915864:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.915875:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863667.915885:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e400, rc 0) 00000100:00100000:1.0:1788863667.915944:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205469952:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 157us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863667.915951:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 332 00000100:00100000:1.0:1788863667.927828:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863667.927950:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470080 00000100:00100000:0.0:1788863667.927961:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470080 00000100:00100000:0.0:1788863667.928026:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 333 00000100:00100000:0.0:1788863667.928038:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205470080:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.928240:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205470080:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 204us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863667.928249:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 333 00000100:00100000:3.0:1788863667.935760:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863667.937243:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470208 00000100:00100000:0.0:1788863667.937258:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470208 00000100:00100000:0.0:1788863667.937333:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 334 00000100:00100000:0.0:1788863667.937344:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205470208:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863667.937521:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205470208:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 178us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863667.937530:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 334 00000100:00100000:1.0:1788863668.205492:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226528256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863668.205575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863668.206241:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528256 00000100:00100000:0.0:1788863668.206252:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528256 00000100:00100000:0.0:1788863668.206325:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788863668.206337:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226528256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863668.206385:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863668.206441:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226528256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863668.206447:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788863668.206578:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863668.206618:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f100 x1875759226528256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863668.206638:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226528256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863668.218332:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863668.219310:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226528384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863668.219653:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863668.220029:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528384 00000100:00100000:2.0:1788863668.220039:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528384 00000100:00100000:2.0:1788863668.220113:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788863668.220123:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226528384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863668.220146:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863668.220199:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226528384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863668.220207:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788863668.220344:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863668.220624:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ce00 x1875759226528384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863668.220645:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226528384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863668.396068:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863668.715955:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226528896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716159:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226529408:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716182:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716214:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863668.716221:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226528512:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716250:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716284:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226529024:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716323:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716343:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226529536:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716363:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716390:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226528640:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716428:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716445:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226529152:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716464:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716479:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226529664:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716501:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716520:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863668.716525:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226528768:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716573:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226529280:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716592:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716602:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226529792:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863668.716666:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528896 00000100:00100000:3.0:1788863668.716674:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528896 00000100:00100000:3.0:1788863668.716710:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529408 00000100:00100000:3.0:1788863668.716713:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529408 00000100:00100000:3.0:1788863668.716731:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529536 00000100:00100000:3.0:1788863668.716733:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529536 00000100:00100000:3.0:1788863668.716744:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528640 00000100:00100000:3.0:1788863668.716746:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528640 00000100:00100000:3.0:1788863668.716756:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529152 00000100:00100000:3.0:1788863668.716758:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529152 00000100:00100000:3.0:1788863668.716767:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529280 00000100:00100000:3.0:1788863668.716769:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529280 00000100:00100000:3.0:1788863668.716784:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788863668.716793:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226528896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716850:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226528896:12345-0@lo:400:kworker.0 Request processed in 58us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.716857:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788863668.716876:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788863668.716883:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226529408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716911:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226529408:12345-0@lo:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.716917:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788863668.716929:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788863668.716935:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226529536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.716973:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226529536:12345-0@lo:400:kworker.0 Request processed in 38us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.716979:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788863668.716992:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788863668.716998:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226528640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717030:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226528640:12345-0@lo:400:kworker.0 Request processed in 32us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.717034:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788863668.717045:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788863668.717051:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226529152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717102:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226529152:12345-0@lo:400:kworker.0 Request processed in 25us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.717108:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788863668.717120:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788863668.717126:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226529280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717152:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226529280:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.717158:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788863668.717179:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529024 00000100:00100000:3.0:1788863668.717183:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529024 00000100:00100000:3.0:1788863668.717203:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528768 00000100:00100000:3.0:1788863668.717205:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528768 00000100:00100000:3.0:1788863668.717216:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788863668.717222:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226529024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717253:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226529024:12345-0@lo:400:kworker.0 Request processed in 31us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.717284:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788863668.717297:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788863668.717303:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226528768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717340:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226528768:12345-0@lo:400:kworker.0 Request processed in 37us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.717347:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788863668.717371:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529664 00000100:00100000:3.0:1788863668.717374:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529664 00000100:00100000:3.0:1788863668.717400:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529792 00000100:00100000:3.0:1788863668.717403:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529792 00000100:00100000:3.0:1788863668.717421:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863668.717427:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226529664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717455:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226529664:12345-0@lo:400:kworker.0 Request processed in 28us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.717461:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863668.717472:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788863668.717477:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226529792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717500:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226529792:12345-0@lo:400:kworker.0 Request processed in 23us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863668.717506:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788863668.717552:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226528768:0@lo:400:kworker.0 00010000:00080000:3.0:1788863668.717568:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c1500 x1875759226529280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863668.717579:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226529280:0@lo:400:kworker.0 00010000:00080000:3.0:1788863668.717587:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c3b80 x1875759226529792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863668.717602:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226529792:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717613:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226528640:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717622:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226529152:0@lo:400:kworker.0 00010000:00080000:3.0:1788863668.717631:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c0700 x1875759226529664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863668.717638:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226529664:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717674:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226529024:0@lo:400:kworker.0 00010000:00080000:3.0:1788863668.717684:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c1f80 x1875759226529536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863668.717692:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226529536:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717702:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226528896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.717712:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226529408:0@lo:400:kworker.0 00000100:00100000:1.0:1788863668.717991:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226528512 00000100:00100000:1.0:1788863668.717996:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226528512 00000100:00100000:1.0:1788863668.718029:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788863668.718036:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226528512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863668.718097:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226528512:12345-0@lo:400:kworker.0 Request processed in 62us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863668.718104:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:1.0:1788863668.718141:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863668.718145:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863668.718148:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863668.718165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226528512:0@lo:400:kworker.0 00000100:00100000:3.0:1788863668.721590:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863668.722185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863668.722595:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863668.722663:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470464 00000100:00100000:1.0:1788863668.722674:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470464 00000100:00100000:1.0:1788863668.722751:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470336 00000100:00100000:1.0:1788863668.722755:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470336 00000100:00100000:1.0:1788863668.722782:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 210 00000100:00100000:1.0:1788863668.722792:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205470464:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863668.726761:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205470464:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 3954us (5165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863668.726779:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 210 00000100:00100000:1.0:1788863668.726829:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 211 00000100:00100000:1.0:1788863668.726845:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205470336:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863668.727036:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205470336:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 198us (4854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863668.727043:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 211 00000100:00080000:1.0:1788863668.727439:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863668.727459:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863668.731074:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863668.731864:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470720 00000100:00100000:1.0:1788863668.731948:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470720 00000100:00100000:1.0:1788863668.732016:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470592 00000100:00100000:1.0:1788863668.732019:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470592 00000100:00100000:1.0:1788863668.732046:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 212 00000100:00100000:1.0:1788863668.732057:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205470720:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863668.733295:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205470720:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1232us (10693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863668.733308:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 212 00000100:00100000:1.0:1788863668.733335:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00100000:1.0:1788863668.733345:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205470592:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863668.733394:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205470592:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863668.733402:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00080000:0.0:1788863668.737406:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863668.737422:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863669.227263:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863669.227352:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226529920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863669.227432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863669.227524:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226529920 00000100:00100000:3.0:1788863669.227533:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226529920 00000100:00100000:3.0:1788863669.227604:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788863669.227614:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226529920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863669.227660:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863669.227709:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226529920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863669.227716:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1788863669.227763:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543bf2680 x1875759226529920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863669.227784:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226529920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863669.228178:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863669.228191:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226530048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863669.228226:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863669.228316:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530048 00000100:00100000:2.0:1788863669.228322:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530048 00000100:00100000:2.0:1788863669.228367:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788863669.228375:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226530048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863669.228388:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863669.228449:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226530048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863669.228471:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788863669.228709:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca8380 x1875759226530048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863669.228725:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226530048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788863669.421398:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863669.739646:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863669.739673:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226530176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863669.739764:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863669.739839:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530176 00000100:00100000:1.0:1788863669.739848:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530176 00000100:00100000:1.0:1788863669.739908:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788863669.739916:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226530176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863669.739955:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863669.740012:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226530176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863669.740019:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788863669.740105:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226530176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863669.745568:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226530304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863669.745643:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863669.745780:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530304 00000100:00100000:2.0:1788863669.745790:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530304 00000100:00100000:2.0:1788863669.745842:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788863669.745851:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226530304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863669.745886:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863669.750715:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226530304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4856us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863669.750731:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788863669.754396:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226530304:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788863670.043871:0:13405:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788863670.443252:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863671.476582:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863672.491438:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863673.324500:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226530432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863673.324641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863673.324734:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863673.324742:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226530560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863673.324785:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863673.324873:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530432 00000100:00100000:1.0:1788863673.324882:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530432 00000100:00100000:1.0:1788863673.324924:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530560 00000100:00100000:1.0:1788863673.324927:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530560 00000100:00100000:1.0:1788863673.324948:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788863673.324958:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226530432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863673.324990:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863673.325412:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226530432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 454us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863673.325420:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788863673.325440:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788863673.325448:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226530560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863673.325458:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863673.325482:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226530560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863673.325488:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788863673.325583:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788863673.325721:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f800 x1875759226530560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863673.325741:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226530560:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788863673.325753:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54408c380 x1875759226530432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863673.325765:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226530432:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788863673.516338:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863673.835502:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226531072:0@lo:400:kworker.0 00000100:00100000:2.0:1788863673.835510:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226530688:0@lo:400:kworker.0 00000100:00100000:0.0:1788863673.835615:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226530816:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.838177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.838297:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226531584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.838342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.838389:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788863673.838398:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226530944:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.838431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.838453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226531456:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.838476:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.838500:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226531968:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.838529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.838583:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531072 00000100:00100000:3.0:1788863673.838594:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531072 00000100:00100000:3.0:1788863673.838667:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531584 00000100:00100000:3.0:1788863673.838671:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531584 00000100:00100000:3.0:1788863673.839004:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531456 00000100:00100000:3.0:1788863673.839021:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531456 00000100:00100000:3.0:1788863673.839049:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788863673.839060:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226531072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863673.839119:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788863673.839135:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226531584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.842175:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226531072:12345-0@lo:400:kworker.0 Request processed in 3087us (3990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.842198:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788863673.842252:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788863673.842354:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226531456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.842548:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226531456:12345-0@lo:400:kworker.0 Request processed in 287us (4070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.842555:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788863673.842597:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530944 00000100:00100000:3.0:1788863673.842606:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530944 00000100:00100000:1.0:1788863673.842610:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226531584:12345-0@lo:400:kworker.0 Request processed in 3055us (3841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863673.842645:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788863673.842732:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788863673.842751:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226530944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.842775:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531968 00000100:00100000:3.0:1788863673.842781:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531968 00000100:00100000:1.0:1788863673.842806:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226530944:12345-0@lo:400:kworker.0 Request processed in 59us (4373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863673.842813:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788863673.842828:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788863673.842838:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.842884:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226531968:12345-0@lo:400:kworker.0 Request processed in 49us (4355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.842893:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788863673.842924:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863673.842931:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863673.843188:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863673.843362:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863673.843410:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863673.843434:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863673.843470:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863673.843497:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863673.843524:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205471104 00000100:00100000:3.0:1788863673.843529:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205471104 00000100:00100000:3.0:1788863673.843558:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205471360 00000100:00100000:3.0:1788863673.843561:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205471360 00000100:00100000:3.0:1788863673.843573:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470976 00000100:00100000:3.0:1788863673.843576:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470976 00000100:00100000:3.0:1788863673.843588:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205471232 00000100:00100000:3.0:1788863673.843591:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205471232 00000100:00100000:3.0:1788863673.843605:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 217 00000100:00100000:3.0:1788863673.843613:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205471104:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863673.843682:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205471104:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.843690:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 217 00000100:00100000:3.0:1788863673.843706:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 218 00000100:00100000:3.0:1788863673.843713:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205471360:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863673.843742:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205471360:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.843749:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 218 00000100:00100000:3.0:1788863673.843762:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 219 00000100:00100000:3.0:1788863673.843770:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205470976:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863673.843798:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205470976:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.843804:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 219 00000100:00100000:3.0:1788863673.843817:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00100000:3.0:1788863673.843831:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205471232:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863673.843861:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205471232:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.843866:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00080000:3.0:1788863673.844346:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863673.844352:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863673.844406:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226530944:0@lo:400:kworker.0 00010000:00080000:3.0:1788863673.844430:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543bf3b80 x1875759226531456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863673.844443:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226531456:0@lo:400:kworker.0 00010000:00080000:3.0:1788863673.844459:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543bf1880 x1875759226531968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863673.844468:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226531968:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.844486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226531072:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.844501:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226531584:0@lo:400:kworker.0 00000100:00100000:0.0:1788863673.846598:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863673.846677:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226531328:0@lo:400:kworker.0 00000100:00100000:0.0:1788863673.846713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.846745:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530816 00000100:00100000:0.0:1788863673.846747:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531328 00000100:00100000:0.0:1788863673.846755:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531328 00000100:00100000:3.0:1788863673.846756:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530816 00000100:00100000:2.0:1788863673.848283:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863673.848359:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205470848 00000100:00100000:2.0:1788863673.848368:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205470848 00000100:00100000:2.0:1788863673.848423:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226530688 00000100:00100000:2.0:1788863673.848428:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226530688 00000100:00100000:3.0:1788863673.848575:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788863673.848588:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226530816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.848865:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226530816:12345-0@lo:400:kworker.0 Request processed in 278us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.848875:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788863673.848985:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 336 00000100:00100000:2.0:1788863673.848996:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205470848:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863673.849129:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788863673.849139:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226531328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863673.849192:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226531328:12345-0@lo:400:kworker.0 Request processed in 55us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863673.849199:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1788863673.849223:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863673.849534:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226531200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.849593:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.849621:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226531712:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.849656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863673.849679:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531712 00000100:00100000:3.0:1788863673.849685:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531712 00000100:00100000:2.0:1788863673.849722:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205470848:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 725us (6360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.849733:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788863673.849737:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 336 00000100:00100000:3.0:1788863673.849744:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226531712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863673.849772:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788863673.849781:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226530688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863673.849814:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226530688:12345-0@lo:400:kworker.0 Request processed in 36us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863673.849820:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788863673.849848:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531200 00000100:00100000:2.0:1788863673.849852:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531200 00000100:00100000:2.0:1788863673.849877:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788863673.849884:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226531200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.849903:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226531712:12345-0@lo:400:kworker.0 Request processed in 160us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.849911:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788863673.849928:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226531200:12345-0@lo:400:kworker.0 Request processed in 43us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863673.849937:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:3.0:1788863673.849961:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543bf1c00 x1875759226531712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863673.849981:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226531712:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.850016:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226530688:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.850027:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226531200:0@lo:400:kworker.0 00000100:00080000:0.0:1788863673.854712:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863673.854865:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226531328:0@lo:400:kworker.0 00000100:00100000:0.0:1788863673.854883:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226531840:0@lo:400:kworker.0 00000100:00100000:0.0:1788863673.855828:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863673.855918:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226530816:0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.857687:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226531840 00000100:00100000:3.0:1788863673.857708:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226531840 00000100:00080000:0.0:1788863673.857793:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863673.858285:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788863673.858311:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226531840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863673.858420:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226531840:12345-0@lo:400:kworker.0 Request processed in 122us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863673.858428:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788863673.858496:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543bf2300 x1875759226531840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863673.858517:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226531840:0@lo:400:kworker.0 00000100:00100000:0.0:1788863674.347933:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863674.347969:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226532096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863674.348176:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863674.348443:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532096 00000100:00100000:1.0:1788863674.348455:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532096 00000100:00100000:1.0:1788863674.348514:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788863674.348526:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226532096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863674.348567:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863674.349009:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226532096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 484us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863674.349018:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1788863674.349176:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54408ed80 x1875759226532096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863674.349202:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226532096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863674.350174:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863674.350198:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226532224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863674.350265:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863674.350337:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532224 00000100:00100000:1.0:1788863674.350347:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532224 00000100:00100000:1.0:1788863674.350394:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788863674.350403:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226532224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863674.350429:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863674.350495:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226532224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863674.350502:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1788863674.350540:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54408ed80 x1875759226532224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863674.350559:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226532224:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863674.542005:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863674.859383:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863674.859393:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863674.859420:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226532480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863674.859423:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226532352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863674.860318:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863674.860614:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532352 00000100:00100000:1.0:1788863674.860625:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532352 00000100:00100000:1.0:1788863674.860686:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788863674.860696:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226532352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863674.860732:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863674.860797:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226532352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863674.860805:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788863674.861036:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226532352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863674.863469:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863674.863804:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532480 00000100:00100000:3.0:1788863674.863821:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532480 00000100:00100000:3.0:1788863674.863894:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788863674.863903:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226532480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863674.863948:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788863674.864044:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226532480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863674.864052:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788863674.864294:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226532480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788863675.563473:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788863675.885999:0:13554:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:34:34 (1788863674) === 00000100:00100000:3.0:1788863676.124635:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.124677:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.124710:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205471488 00000100:00100000:3.0:1788863676.124723:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205471488 00000100:00100000:3.0:1788863676.124797:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:3.0:1788863676.124809:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205471488:12345-192.168.204.35@tcp:41:mkdir.0 00000004:00000024:3.0:1788863676.124858:0:10368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788863676.124958:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205471488:12345-192.168.204.35@tcp:41:mkdir.0 Request processed in 151us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863676.124965:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00080000:3.0:1788863676.124986:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863676.128532:0:6546:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205471616 00000100:00100000:2.0:1788863676.128551:0:6546:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205471616 00000100:00100000:2.0:1788863676.128632:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:2.0:1788863676.128643:0:6546:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:10509:x1875759205471616:12345-192.168.204.35@tcp:700:mkdir.0 00000100:00100000:2.0:1788863676.128773:0:6546:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:10509:x1875759205471616:12345-192.168.204.35@tcp:700:mkdir.0 Request processed in 131us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863676.128803:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1788863676.132467:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863676.133464:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205471872 00000100:00100000:0.0:1788863676.133484:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205471872 00000100:00100000:0.0:1788863676.133607:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:0.0:1788863676.133620:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:10509:x1875759205471872:12345-192.168.204.35@tcp:36:mkdir.0 00010000:00010000:0.0:1788863676.133698:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863676.133902:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b68d31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dae expref: 6 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.133934:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e650ec3600) 00010000:00010000:0.0:1788863676.133947:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863676.134052:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134132:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134145:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134184:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134194:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134201:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134732:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134744:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134751:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863676.134765:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b59705d9 reply state 000000002eec29d5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134775:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134781:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:0.0:1788863676.134790:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863676.134793:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788863676.134798:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788863676.134806:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134813:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134819:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134825:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863676.134829:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134835:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134845:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:0.0:1788863676.134847:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863676.134851:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134856:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68e8f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863676.134871:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b59705d9 reply state 000000002eec29d5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134879:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.134896:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e6625eb200) 00010000:00010000:0.0:1788863676.134898:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863676.134900:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788863676.135009:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:10509:x1875759205471872:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 1390us (2555us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788863676.135019:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:2.0:1788863676.160962:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.161305:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205472000 00000100:00100000:3.0:1788863676.161320:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205472000 00000100:00100000:3.0:1788863676.161402:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:3.0:1788863676.161416:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:10510:x1875759205472000:12345-192.168.204.35@tcp:101:chmod.0 00010000:00010000:3.0:1788863676.161472:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863676.161506:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e41 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.161596:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68eab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.161616:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.161631:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863676.161706:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788863676.161711:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863676.161762:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.161796:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e41 expref: 9 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.161818:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e41 expref: 8 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.161827:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e650ec3300) 00010000:00010000:3.0:1788863676.161830:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863676.161835:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030400, rc 0) 00000100:00100000:3.0:1788863676.161921:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:10510:x1875759205472000:12345-192.168.204.35@tcp:101:chmod.0 Request processed in 507us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863676.161929:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:3.0:1788863676.168856:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863676.169138:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205472256 00000100:00100000:0.0:1788863676.170347:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205472256 00000100:00100000:0.0:1788863676.170458:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:0.0:1788863676.170470:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:10510:x1875759205472256:12345-192.168.204.35@tcp:36:chmod.0 00010000:00010000:0.0:1788863676.170548:0:12972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863676.170587:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68eab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e41 expref: 8 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.170614:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e650ec3300) 00010000:00010000:0.0:1788863676.170628:0:12972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863676.170664:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.170681:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.170696:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863676.170977:0:12972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fedf2619 reply state 00000000ad80e88e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.171006:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.171013:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:0.0:1788863676.171016:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788863676.171019:0:12972:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788863676.171029:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788863676.171519:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:10510:x1875759205472256:12345-192.168.204.35@tcp:36:chmod.0 Request processed in 1046us (2677us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788863676.171530:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:0.0:1788863676.211756:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.211893:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205472384 00000100:00100000:3.0:1788863676.212702:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205472384 00000100:00100000:3.0:1788863676.212788:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:3.0:1788863676.212801:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:10511:x1875759205472384:12345-192.168.204.35@tcp:101:chown.0 00010000:00010000:3.0:1788863676.212833:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863676.212859:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e48 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.212962:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b68ec0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.214455:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b68ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.214479:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b68ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863676.214861:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788863676.214866:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863676.214929:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b68ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.216792:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e48 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.216841:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b68ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e48 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.216854:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:3.0:1788863676.216881:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863676.216887:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031400, rc 0) 00000100:00100000:2.0:1788863676.217753:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:10511:x1875759205472384:12345-192.168.204.35@tcp:101:chown.0 Request processed in 4947us (6273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863676.217765:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:2.0:1788863676.222602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.222807:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205472512 00000100:00100000:3.0:1788863676.222823:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205472512 00000100:00100000:3.0:1788863676.222909:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:3.0:1788863676.222921:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:10511:x1875759205472512:12345-192.168.204.35@tcp:101:chown.0 00010000:00010000:3.0:1788863676.222950:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863676.223592:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e4f expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.224023:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.224044:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.224060:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.224073:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.224315:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.224324:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224749:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68edc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224761:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224772:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863676.224846:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788863676.224850:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863676.224880:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224896:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224904:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224913:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224919:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863676.224924:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.224953:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225748:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:2.0:1788863676.225756:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863676.225765:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225774:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68ece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225807:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225814:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225821:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225826:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863676.225829:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225837:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225848:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e6625eb200) 00010000:00010000:2.0:1788863676.225851:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863676.225864:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225889:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68ed5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225944:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e4f expref: 12 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225963:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e4f expref: 11 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.225983:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:2.0:1788863676.225986:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863676.225989:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99c00, rc 0) 00000100:00100000:2.0:1788863676.226351:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:10511:x1875759205472512:12345-192.168.204.35@tcp:101:chown.0 Request processed in 3429us (3979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863676.226363:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:2.0:1788863676.234434:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863676.234641:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205472640 00000100:00100000:1.0:1788863676.234657:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205472640 00000100:00100000:1.0:1788863676.234740:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:1.0:1788863676.234752:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:10511:x1875759205472640:12345-192.168.204.35@tcp:900:chown.0 00000100:00100000:1.0:1788863676.234896:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:10511:x1875759205472640:12345-192.168.204.35@tcp:900:chown.0 Request processed in 145us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863676.234904:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:0.0:1788863676.241245:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.241680:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205472896 00000100:00100000:3.0:1788863676.241694:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205472896 00000100:00100000:3.0:1788863676.241780:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:3.0:1788863676.241818:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:10511:x1875759205472896:12345-192.168.204.35@tcp:36:chown.0 00010000:00010000:3.0:1788863676.241916:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863676.241959:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e4f expref: 11 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.241984:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:3.0:1788863676.241990:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863676.242233:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.242252:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.242266:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863676.259928:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1788863676.260363:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260378:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260406:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260412:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863676.260417:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260424:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260444:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e6625eb200) 00010000:00010000:1.0:1788863676.260448:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863676.260453:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260460:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68e96 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260484:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260489:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260494:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260499:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863676.260501:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260515:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260524:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:1.0:1788863676.260526:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863676.260529:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260534:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b68e9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260547:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260552:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260558:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260562:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863676.260565:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260569:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260576:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:1.0:1788863676.260578:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788863676.260581:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.260595:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91000/0xf569beb9d4b68eb2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863676.260850:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000295df07e reply state 0000000052b8ca73 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.260866:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.260873:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:2.0:1788863676.260875:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788863676.260878:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788863676.260891:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788863676.261378:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788863676.261405:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:10511:x1875759205472896:12345-192.168.204.35@tcp:36:chown.0 Request processed in 19583us (20170us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788863676.261424:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00010000:00010000:1.0:1788863676.263575:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.263593:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.263600:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.263606:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863676.263611:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.263618:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.263636:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:1.0:1788863676.263639:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788863676.263644:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.263650:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91c00/0xf569beb9d4b68ee3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863676.316700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863676.317520:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205473024 00000100:00100000:2.0:1788863676.317545:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205473024 00000100:00100000:2.0:1788863676.317651:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:2.0:1788863676.317664:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:10512:x1875759205473024:12345-192.168.204.35@tcp:101:touch.500 00010000:00010000:2.0:1788863676.317699:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863676.317731:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b68eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e56 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863676.319481:0:6537:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1678us 00010000:00010000:1.0:1788863676.356398:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356425:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356463:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356483:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356492:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356499:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356650:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b68eff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356659:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b68eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356665:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b68eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863676.356696:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788863676.356699:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863676.356738:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b68eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356751:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356758:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356775:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356780:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863676.356784:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356791:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356802:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:1.0:1788863676.356805:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863676.356810:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356817:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b68ef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356834:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356843:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356849:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356854:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863676.356856:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356876:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356884:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e643aa2000) 00010000:00010000:1.0:1788863676.356886:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863676.356889:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356894:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68ef8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356937:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b68eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e56 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356955:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b68eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e56 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.356962:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:1.0:1788863676.356964:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788863676.356966:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f600, rc 0) 00000100:00100000:1.0:1788863676.358940:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:10512:x1875759205473024:12345-192.168.204.35@tcp:101:touch.500 Request processed in 41267us (42244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863676.358951:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:2.0:1788863676.366384:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.366640:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205473280 00000100:00100000:3.0:1788863676.366660:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205473280 00000100:00100000:3.0:1788863676.366768:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:3.0:1788863676.366785:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:10512:x1875759205473280:12345-192.168.204.35@tcp:101:touch.500 00010000:00010000:3.0:1788863676.366812:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863676.366837:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f06 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e5d expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.366992:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.367019:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.367035:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.367053:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.367061:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.367121:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788863676.367744:0:6538:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788863676.367945:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68f1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.367959:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.367968:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368012:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368021:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368028:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368035:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863676.368041:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368051:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368067:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:3.0:1788863676.368070:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863676.368125:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368134:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f0d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863676.368154:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae71dcfd reply state 00000000252a60cd transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.368169:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.369384:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff89e650ec3900) 00010000:00010000:3.0:1788863676.369390:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863676.369395:0:6538:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788863676.369474:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f06 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e5d expref: 10 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.369501:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68f1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e5d expref: 9 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.369510:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e650ec3b00) 00010000:00010000:3.0:1788863676.369513:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863676.369516:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030000, rc 0) 00000100:00100000:3.0:1788863676.369696:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:10512:x1875759205473280:12345-192.168.204.35@tcp:101:touch.500 Request processed in 2917us (3320us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788863676.369707:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:3.0:1788863676.376585:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863676.376943:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205473536 00000100:00100000:2.0:1788863676.376960:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205473536 00000100:00100000:2.0:1788863676.377222:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:2.0:1788863676.377240:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:10512:x1875759205473536:12345-192.168.204.35@tcp:36:touch.500 00010000:00010000:2.0:1788863676.377327:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863676.377364:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68f1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e5d expref: 10 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.377389:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e650ec3b00) 00010000:00010000:2.0:1788863676.377403:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863676.377485:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.377502:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.377514:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863676.377702:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c124807 reply state 00000000c58401f8 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.377717:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.377724:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e542bf2c00) 00010000:00010000:2.0:1788863676.377727:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863676.377730:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863676.378407:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:10512:x1875759205473536:12345-192.168.204.35@tcp:36:touch.500 Request processed in 1168us (1832us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788863676.378417:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:3.0:1788863676.382719:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863676.382814:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205473664 00000100:00100000:1.0:1788863676.382837:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205473664 00000100:00100000:1.0:1788863676.382945:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:1.0:1788863676.382958:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:10512:x1875759205473664:12345-192.168.204.35@tcp:101:touch.500 00010000:00010000:1.0:1788863676.383007:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863676.383033:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e64 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.383165:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e64 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.383183:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e64 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.383203:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e542bf2c00) 00010000:00010000:1.0:1788863676.383207:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863676.383210:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863676.383282:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:10512:x1875759205473664:12345-192.168.204.35@tcp:101:touch.500 Request processed in 327us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863676.383290:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:3.0:1788863676.386932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863676.387141:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205473792 00000100:00100000:0.0:1788863676.387158:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205473792 00000100:00100000:0.0:1788863676.387336:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:0.0:1788863676.387347:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2407:x1875759205473792:12345-192.168.204.35@tcp:8:touch.500 00010000:00080000:0.0:1788863676.387402:0:8606:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:0.0:1788863676.387456:0:8606:0:(genops.c:1384:class_connect()) connect: client 7a6822fa-e36f-4316-b7e3-4bba6134cbda, cookie 0xf569beb9d4b68f37 00002000:00100000:0.0:1788863676.387473:0:8606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a6822fa-e36f-4316-b7e3-4bba6134cbda/ffff89e67c4ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788863676.387497:0:8606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1788863676.387687:0:8606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788863676.387729:0:8606:0:(import.c:65:import_set_state_nolock()) ffff89e67c4cd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863676.388057:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2407:x1875759205473792:12345-192.168.204.35@tcp:8:touch.500 Request processed in 709us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863676.388068:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:0.0:1788863676.398360:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.398677:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205473920 00000100:00100000:3.0:1788863676.398692:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205473920 00000100:00100000:3.0:1788863676.398814:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:3.0:1788863676.398827:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:0:x1875759205473920:12345-192.168.204.35@tcp:2:touch.500 00000100:00080000:0.0:1788863676.399657:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788863676.406940:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1788863676.406958:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000100:00100000:3.0:1788863676.407779:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:0:x1875759205473920:12345-192.168.204.35@tcp:2:touch.500 Request processed in 8947us (9428us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788863676.407791:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:3.0:1788863676.413382:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863676.413630:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205474176 00000100:00100000:0.0:1788863676.413645:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205474176 00000100:00100000:0.0:1788863676.413723:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:0.0:1788863676.413736:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:10512:x1875759205474176:12345-192.168.204.35@tcp:35:touch.500 00000100:00100000:1.0:1788863676.414504:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:10512:x1875759205474176:12345-192.168.204.35@tcp:35:touch.500 Request processed in 757us (1315us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788863676.414527:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:2.0:1788863676.446932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.447017:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205474304 00000100:00100000:3.0:1788863676.447028:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205474304 00000100:00100000:3.0:1788863676.447121:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:3.0:1788863676.447132:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:10513:x1875759205474304:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788863676.447161:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863676.447182:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e6b expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.447255:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.447270:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.447282:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863676.447329:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788863676.447333:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863676.447370:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.447416:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e6b expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.447436:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e6b expref: 14 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.447444:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:3.0:1788863676.447447:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863676.447451:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031600, rc 0) 00000100:00100000:3.0:1788863676.448379:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:10513:x1875759205474304:12345-192.168.204.35@tcp:101:rm.0 Request processed in 1242us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863676.448389:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:3.0:1788863676.454230:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863676.454586:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205474560 00000100:00100000:2.0:1788863676.454597:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205474560 00000100:00100000:2.0:1788863676.454663:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:2.0:1788863676.454672:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:10513:x1875759205474560:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1788863676.454695:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863676.454717:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b68f4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e72 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863676.454886:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788863676.455050:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b68f4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e72 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.455204:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:2.0:1788863676.455208:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863676.455215:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b68f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e72 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.455230:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99600, rc 0) 00000100:00100000:2.0:1788863676.455312:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:10513:x1875759205474560:12345-192.168.204.35@tcp:101:rm.0 Request processed in 640us (1091us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788863676.455320:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:1.0:1788863676.460964:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.461842:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205474688 00000100:00100000:3.0:1788863676.461856:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205474688 00000100:00100000:3.0:1788863676.461936:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:3.0:1788863676.461947:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:10513:x1875759205474688:12345-192.168.204.35@tcp:37:rm.0 00000100:00100000:0.0:1788863676.476995:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:10513:x1875759205474688:12345-192.168.204.35@tcp:37:rm.0 Request processed in 15038us (16033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863676.477020:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:0.0:1788863676.494688:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863676.494868:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205474944 00000100:00100000:1.0:1788863676.494885:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205474944 00000100:00100000:1.0:1788863676.494967:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:1.0:1788863676.494978:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:10513:x1875759205474944:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:1.0:1788863676.495271:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:10513:x1875759205474944:12345-192.168.204.35@tcp:35:rm.0 Request processed in 292us (595us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788863676.495297:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:1.0:1788863676.504298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.504479:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205475200 00000100:00100000:3.0:1788863676.504490:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205475200 00000100:00100000:3.0:1788863676.504552:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:3.0:1788863676.504562:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:10513:x1875759205475200:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1788863676.504587:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863676.504618:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e79 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.504829:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f61 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.504857:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.504869:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863676.504882:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788863676.505018:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e79 expref: 19 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.505037:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e79 expref: 18 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.505046:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:3.0:1788863676.505049:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788863676.505053:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030800, rc 0) 00000100:00100000:3.0:1788863676.505328:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:10513:x1875759205475200:12345-192.168.204.35@tcp:101:rm.0 Request processed in 766us (1039us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788863676.505336:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:3.0:1788863676.510977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863676.511281:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205475328 00000100:00100000:0.0:1788863676.511295:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205475328 00000100:00100000:0.0:1788863676.511375:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:0.0:1788863676.511388:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:10513:x1875759205475328:12345-192.168.204.35@tcp:41:rm.0 00000004:00000024:0.0:1788863676.511472:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788863676.511638:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:10513:x1875759205475328:12345-192.168.204.35@tcp:41:rm.0 Request processed in 251us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863676.511647:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:0.0:1788863676.519463:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863676.523419:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205475456 00000100:00100000:2.0:1788863676.523443:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205475456 00000100:00100000:2.0:1788863676.523526:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:2.0:1788863676.523537:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:10513:x1875759205475456:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1788863676.523565:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863676.523591:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68f6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e80 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523675:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523694:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523711:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523724:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523752:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523760:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523878:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b68f84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523887:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b68f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523895:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b68f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863676.523936:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788863676.523941:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863676.523965:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b68f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523979:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b68f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.523988:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.524010:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.524019:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.524039:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863676.524045:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525252:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525284:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:2.0:1788863676.525287:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863676.525294:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525302:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b68f76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525325:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525332:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525339:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525345:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863676.525349:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525356:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525385:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff89e650ec3900) 00010000:00010000:2.0:1788863676.525388:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863676.525391:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525398:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b68f7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525452:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b68f6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e80 expref: 20 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525468:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b68f84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e80 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863676.525476:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e542bf2c00) 00010000:00010000:2.0:1788863676.525478:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863676.525480:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:2.0:1788863676.525587:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:10513:x1875759205475456:12345-192.168.204.35@tcp:101:rm.0 Request processed in 2049us (6140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863676.525597:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:1.0:1788863676.531647:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863676.531799:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205475712 00000100:00100000:3.0:1788863676.531814:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205475712 00000100:00100000:3.0:1788863676.531897:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:3.0:1788863676.531910:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:10513:x1875759205475712:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:3.0:1788863676.531987:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788863676.532033:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b68f84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e80 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532151:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b68f30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e64 expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532166:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e542bf2c00) 00010000:00010000:3.0:1788863676.532178:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b68f45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e6b expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532188:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:3.0:1788863676.532193:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863676.532227:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532245:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532256:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532271:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532278:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532284:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532405:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532427:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.532434:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863676.533469:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788863676.533484:0:10368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343657407132ns, next at 344657403725ns, rc = 0 00010000:00010000:3.0:1788863676.533935:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.533956:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.533970:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.533992:0:10368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534014:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534022:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534484:0:10368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863676.534517:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534525:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534563:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534569:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863676.534575:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534585:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534601:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e542bf2c00) 00010000:00010000:3.0:1788863676.534605:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788863676.534610:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534618:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030400/0xf569beb9d4b68f99 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534643:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534650:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534656:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534662:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863676.534665:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534682:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534692:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:3.0:1788863676.534694:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863676.534698:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534704:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b68f8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863676.534716:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f56b330 reply state 00000000ea043d16 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534729:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863676.534736:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff89e650ec3900) 00010000:00010000:3.0:1788863676.534738:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863676.534742:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863676.534868:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:10513:x1875759205475712:12345-192.168.204.35@tcp:36:rm.0 Request processed in 2954us (3232us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788863676.534879:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:3.0:1788863676.539065:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863676.539233:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205475968 00000100:00100000:1.0:1788863676.539247:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205475968 00000100:00100000:1.0:1788863676.539328:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:1.0:1788863676.539341:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:10513:x1875759205475968:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:1.0:1788863676.539659:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:10513:x1875759205475968:12345-192.168.204.35@tcp:35:rm.0 Request processed in 319us (620us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788863676.539668:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00010000:00010000:0.0:1788863676.542564:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863676.542585:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.542599:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863676.542604:0:9549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.542616:0:9549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.542641:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e542bf2c00) 00010000:00010000:0.0:1788863676.542645:0:9549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788863676.542652:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.542659:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b68fa0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.542683:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863676.542685:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863676.542687:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863676.544024:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863676.544172:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205476224 00000100:00100000:0.0:1788863676.544185:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205476224 00000100:00100000:0.0:1788863676.544261:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:0.0:1788863676.544273:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:10513:x1875759205476224:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:0.0:1788863676.544357:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788863676.544390:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b68f61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e79 expref: 19 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544442:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b68eff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e56 expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544455:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:0.0:1788863676.544473:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b68ec0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e48 expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544482:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625eb600) 00010000:00010000:0.0:1788863676.544488:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863676.544521:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544536:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544547:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544562:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544570:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544576:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544688:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544707:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.544715:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863676.545013:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788863676.545033:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545042:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545050:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545057:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863676.545064:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545073:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545130:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863676.545132:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788863676.545136:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545142:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b68fb5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545164:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545178:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545184:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545189:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863676.545192:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545199:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545206:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:0.0:1788863676.545209:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863676.545213:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545218:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b68fa7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863676.545232:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062a29a72 reply state 000000004d45008a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545245:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863676.545251:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e6625eb200) 00010000:00010000:0.0:1788863676.545254:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863676.545258:0:6538:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863676.545724:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:10513:x1875759205476224:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1446us (1706us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788863676.545746:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00010000:00010000:1.0:1788863676.587468:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863677.615103:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788863678.444497:0:8603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345568417161ns, next at 346568413366ns, rc = 0 00000100:00100000:2.0:1788863678.444578:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863678.444620:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226532608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863678.444718:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863678.445248:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532608 00000100:00100000:0.0:1788863678.445261:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532608 00000100:00100000:1.0:1788863678.445326:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863678.445331:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788863678.445338:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226532736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863678.445343:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226532608:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863678.445378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788863678.445381:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863678.445444:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226532608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863678.445452:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788863678.445471:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532736 00000100:00100000:0.0:1788863678.445474:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532736 00000100:00100000:0.0:1788863678.445491:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788863678.445496:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226532736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863678.445507:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863678.445537:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226532736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863678.445543:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788863678.445622:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863678.445735:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54408d500 x1875759226532736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863678.445759:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226532736:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788863678.445797:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681e2ed80 x1875759226532608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863678.445810:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226532608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863678.635774:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863678.956929:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226533248:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.956998:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957069:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226533760:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957113:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957139:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226534272:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957182:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788863678.957187:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226532864:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957232:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226533376:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957269:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226533888:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957289:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957306:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226534400:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957326:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957350:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226533120:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957390:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957409:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226533632:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957429:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957442:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226534144:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957477:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788863678.957482:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226532992:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957521:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226533504:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957567:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226534016:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957590:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863678.957628:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226533248 00000100:00100000:2.0:1788863678.957635:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226533248 00000100:00100000:2.0:1788863678.957670:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226533632 00000100:00100000:2.0:1788863678.957673:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226533632 00000100:00100000:3.0:1788863678.957680:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226533760 00000100:00100000:3.0:1788863678.957684:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226533760 00000100:00100000:2.0:1788863678.957693:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534144 00000100:00100000:2.0:1788863678.957695:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534144 00000100:00100000:3.0:1788863678.957701:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534272 00000100:00100000:3.0:1788863678.957704:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534272 00000100:00100000:2.0:1788863678.957706:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532992 00000100:00100000:2.0:1788863678.957708:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532992 00000100:00100000:3.0:1788863678.957715:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226533888 00000100:00100000:3.0:1788863678.957717:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226533888 00000100:00100000:2.0:1788863678.957717:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226533504 00000100:00100000:2.0:1788863678.957719:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226533504 00000100:00100000:2.0:1788863678.957729:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534016 00000100:00100000:2.0:1788863678.957731:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534016 00000100:00100000:3.0:1788863678.957733:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534400 00000100:00100000:3.0:1788863678.957736:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534400 00000100:00100000:3.0:1788863678.957749:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863678.957749:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788863678.957757:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226533760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957757:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226533248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957807:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226533248:12345-0@lo:400:kworker.0 Request processed in 50us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863678.957814:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788863678.957832:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788863678.957838:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226533632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957868:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226533632:12345-0@lo:400:kworker.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863678.957869:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788863678.957874:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788863678.957877:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226534144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.957884:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788863678.957889:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226532992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863678.957907:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226534144:12345-0@lo:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863678.957908:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226532992:12345-0@lo:400:kworker.0 Request processed in 20us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863678.957919:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788863678.957967:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226533760:12345-0@lo:400:kworker.0 Request processed in 210us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863678.957973:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788863678.957986:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788863678.957992:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226534272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863678.958019:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226534272:12345-0@lo:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863678.958024:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788863678.958035:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863678.958040:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226533888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863678.958103:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226533888:12345-0@lo:400:kworker.0 Request processed in 62us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863678.958109:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863678.958122:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788863678.958127:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226534400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863678.958153:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226534400:12345-0@lo:400:kworker.0 Request processed in 27us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863678.958158:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788863678.958176:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226533376 00000100:00100000:3.0:1788863678.958180:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226533376 00000100:00100000:3.0:1788863678.958202:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226533120 00000100:00100000:3.0:1788863678.958204:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226533120 00000100:00100000:3.0:1788863678.958215:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788863678.958230:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226533376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863678.958267:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226533376:12345-0@lo:400:kworker.0 Request processed in 39us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863678.958272:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788863678.958283:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788863678.958289:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863678.958314:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226533120:12345-0@lo:400:kworker.0 Request processed in 25us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863678.958319:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788863678.958693:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788863678.958709:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788863678.959322:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226532864 00000100:00100000:3.0:1788863678.959329:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226532864 00000100:00100000:3.0:1788863678.959374:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788863678.959382:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226532864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863678.959444:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226532864:12345-0@lo:400:kworker.0 Request processed in 62us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863678.959449:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788863678.960438:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226533504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.960498:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226533504:12345-0@lo:400:kworker.0 Request processed in 69us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863678.960506:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788863678.960529:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788863678.960536:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226534016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.960566:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226534016:12345-0@lo:400:kworker.0 Request processed in 31us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863678.960571:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:2.0:1788863678.960590:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863678.961192:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863678.961198:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863678.961350:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226532992:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.961382:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226533504:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.961395:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226534016:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.961407:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226533120:0@lo:400:kworker.0 00010000:00080000:2.0:1788863678.961421:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af55f80 x1875759226533632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863678.961431:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226533632:0@lo:400:kworker.0 00010000:00080000:2.0:1788863678.961441:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef7800 x1875759226534144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863678.961471:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226534144:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.961541:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226532864:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.961554:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226533376:0@lo:400:kworker.0 00010000:00080000:2.0:1788863678.961566:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef4000 x1875759226533888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863678.961574:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226533888:0@lo:400:kworker.0 00010000:00080000:2.0:1788863678.961585:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef7480 x1875759226534400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863678.961592:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226534400:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.962101:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226533248:0@lo:400:kworker.0 00010000:00080000:2.0:1788863678.962117:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef6a00 x1875759226533760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863678.962125:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226533760:0@lo:400:kworker.0 00010000:00080000:2.0:1788863678.962135:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef4a80 x1875759226534272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863678.962141:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226534272:0@lo:400:kworker.0 00000100:00100000:2.0:1788863678.966914:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863678.966964:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863678.967009:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863678.967013:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205476480 00000100:00100000:3.0:1788863678.967035:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205476480 00000100:00100000:2.0:1788863678.967051:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863678.967137:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863678.967193:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863678.967236:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205476608 00000100:00100000:2.0:1788863678.967245:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205476608 00000100:00100000:3.0:1788863678.967289:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205476864 00000100:00100000:3.0:1788863678.967295:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205476864 00000100:00100000:2.0:1788863678.967296:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205476992 00000100:00100000:2.0:1788863678.967302:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205476992 00000100:00100000:2.0:1788863678.967348:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 230 00000100:00100000:2.0:1788863678.967357:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:2408:x1875759205476480:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863678.967359:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205476352 00000100:00100000:1.0:1788863678.967364:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205476352 00000100:00100000:1.0:1788863678.967394:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 339 00000100:00100000:1.0:1788863678.967402:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205476352:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863678.967472:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205476352:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863678.967480:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 339 00000100:00100000:1.0:1788863678.967597:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 231 00000100:00100000:1.0:1788863678.967606:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205476608:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863678.967643:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205476608:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863678.967649:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 231 00000100:00100000:1.0:1788863678.967666:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 232 00000100:00100000:1.0:1788863678.967672:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205476864:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863678.967696:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205476864:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863678.967702:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 232 00000100:00100000:1.0:1788863678.967713:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 233 00000100:00100000:1.0:1788863678.967719:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205476992:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863678.967740:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205476992:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863678.967745:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 233 00000100:00100000:2.0:1788863678.968887:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:2408:x1875759205476480:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1524us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863678.968902:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 230 00000100:00080000:2.0:1788863678.968941:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863678.968947:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863678.968980:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205476736 00000100:00100000:2.0:1788863678.968987:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205476736 00000100:00100000:2.0:1788863678.969037:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:2.0:1788863678.969046:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205476736:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863678.969103:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205476736:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 58us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863678.969110:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00080000:2.0:1788863678.969126:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863679.471904:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226534656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863679.472073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863679.472175:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863679.472184:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226534528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863679.472211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863679.472261:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534656 00000100:00100000:2.0:1788863679.472271:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534656 00000100:00100000:2.0:1788863679.472330:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534528 00000100:00100000:2.0:1788863679.472334:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534528 00000100:00100000:2.0:1788863679.472352:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788863679.472362:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226534656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863679.472718:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863679.472784:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226534656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 422us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863679.472792:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788863679.472816:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788863679.472823:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226534528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863679.472834:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863679.472860:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226534528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863679.472866:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788863679.472911:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54408d500 x1875759226534528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863679.472934:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226534528:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788863679.472948:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438c3100 x1875759226534656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863679.472961:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226534656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863679.659415:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863679.979687:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226534784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863679.979798:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863679.980665:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534784 00000100:00100000:0.0:1788863679.980681:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534784 00000100:00100000:0.0:1788863679.980764:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788863679.980776:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226534784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863679.980828:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863679.980933:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226534784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863679.980965:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788863679.982681:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226534784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863679.984157:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226534912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863679.984265:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863679.984685:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226534912 00000100:00100000:2.0:1788863679.984713:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226534912 00000100:00100000:2.0:1788863679.984888:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788863679.984901:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226534912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863679.984971:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863679.985437:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226534912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 536us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863679.985447:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788863679.985715:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226534912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788863680.687903:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863681.269533:0:13704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788863681.707384:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788863682.030538:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788863682.030668:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788863682.030680:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788863682.030735:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030747:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030754:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030760:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863682.030766:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030774:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030794:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff89e650ec3900) 00010000:00010000:1.0:1788863682.030798:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863682.030803:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030822:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b68f14 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030844:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030867:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030873:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030878:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863682.030881:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030898:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030907:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff89e542bf2c00) 00010000:00010000:1.0:1788863682.030909:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863682.030912:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030918:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b68f29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030937:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030943:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030949:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030954:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863682.030962:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.030968:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031225:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff89e650ec3900) 00010000:00010000:1.0:1788863682.031229:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863682.031233:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031239:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b68f92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031257:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031263:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031270:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031275:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863682.031278:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031284:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031292:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e6625eb200) 00010000:00010000:1.0:1788863682.031295:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863682.031305:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.031311:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90000/0xf569beb9d4b68fae lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863682.031925:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226535040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788863682.034378:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863682.034528:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226535040 00000100:00100000:0.0:1788863682.034538:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226535040 00000100:00100000:0.0:1788863682.034617:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863682.034628:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226535040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788863682.034658:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788863682.034697:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9fe4bc, atime: 0x6a9fe4bc, ctime: 0x6a9fe4bc, blocks: 0x0 00010000:00010000:0.0:1788863682.034704:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.034720:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788863682.034724:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863682.034730:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.034746:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.034757:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.034765:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.034795:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788863682.034984:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863682.035219:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863682.035226:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.035235:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863682.035240:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.035249:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.035268:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.035276:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009adb4c90/0xf569beb9d4b68fbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863682.035304:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863682.035306:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863682.035308:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863682.041394:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226535040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6757us (7013us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788863682.041409:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1788863682.041589:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e541ef7480/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788863682.041596:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226535040:0@lo:6:osp-syn-0-0.0 00000020:00000080:0.0:1788863682.532440:0:13752:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3aa4e360 20000000:00000080:0.0:1788863682.532458:0:13752:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e5438ed800 uarg=0000000000000000 20000000:01000000:0.0:1788863682.533229:0:13752:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788863682.533236:0:13752:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788863682.533241:0:13752:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788863682.534787:0:13753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788863682.535329:0:13752:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788863682.543029:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788863682.543067:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788863682.543363:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788863682.543384:0:13752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788863682.543404:0:13752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543423:0:13752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543431:0:13752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543438:0:13752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543445:0:13752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543469:0:13752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543476:0:13752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543484:0:13752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543523:0:13752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543547:0:13752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 12 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.543562:0:13752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535168:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863682.543678:0:13752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543687:0:13752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.543695:0:13752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535296:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863682.543724:0:13752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543733:0:13752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.543752:0:13752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535424:0@lo:104: 00000100:00100000:0.0:1788863682.543792:0:13752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863682.543831:0:13752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543839:0:13752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.543847:0:13752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535552:0@lo:104: 00010000:00010000:0.0:1788863682.543869:0:13752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543875:0:13752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.543893:0:13752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535680:0@lo:104: 00010000:00010000:0.0:1788863682.543915:0:13752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.543922:0:13752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 23 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.543929:0:13752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535808:0@lo:104: 00000100:00100000:0.0:1788863682.543943:0:13752:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863682.544374:0:6521:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788863682.544398:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863682.544426:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863682.544446:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863682.544462:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226535424 00000100:00100000:3.0:1788863682.544470:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226535424 00000100:00100000:3.0:1788863682.544506:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226535552 00000100:00100000:3.0:1788863682.544508:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226535552 00000100:00100000:3.0:1788863682.544518:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226535680 00000100:00100000:3.0:1788863682.544521:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226535680 00000100:00100000:3.0:1788863682.544542:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226535808 00000100:00100000:3.0:1788863682.544545:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226535808 00000100:00100000:3.0:1788863682.544559:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863682.544567:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54342b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:13752:x1875759226535424:12345-0@lo:104: 00010000:00010000:3.0:1788863682.544580:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.544631:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863682.544637:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54342b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+6:13752:x1875759226535424:12345-0@lo:104: Request processed in 71us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863682.544645:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863682.544697:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863682.544704:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:13752:x1875759226535552:12345-0@lo:104: 00010000:00010000:3.0:1788863682.544711:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.544742:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788863682.544747:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+5:13752:x1875759226535552:12345-0@lo:104: Request processed in 45us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863682.544752:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863682.544763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863682.544768:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:13752:x1875759226535680:12345-0@lo:104: 00010000:00010000:3.0:1788863682.544774:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.544812:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788863682.544817:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+4:13752:x1875759226535680:12345-0@lo:104: Request processed in 50us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863682.544822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863682.544834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863682.544839:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13752:x1875759226535808:12345-0@lo:104: 00010000:00010000:3.0:1788863682.544846:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.544869:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788863682.544873:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+3:13752:x1875759226535808:12345-0@lo:104: Request processed in 34us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863682.545028:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788863682.545050:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788863682.545057:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545065:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91e00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863682.545069:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545109:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863682.545118:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863682.545124:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863682.545161:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545167:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863682.545184:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545191:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d91e00/0xf569beb9d4b68e73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e7a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545220:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788863682.545223:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545228:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650115400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863682.545231:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545237:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863682.545243:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863682.545248:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863682.545261:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545266:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863682.545283:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545300:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650115400/0xf569beb9d4b68e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e6c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545312:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863682.545314:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545319:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90e00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863682.545322:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545329:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863682.545334:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863682.545339:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863682.545350:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545355:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863682.545361:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545367:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d90e00/0xf569beb9d4b68e57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e5e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545376:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863682.545383:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545388:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863682.545391:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545397:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863682.545402:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863682.545406:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863682.545418:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545423:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863682.545429:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545434:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d90a00/0xf569beb9d4b68e49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b68e50 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.545448:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863682.545450:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863682.545452:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863682.545459:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863682.545471:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226536064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863682.545504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863682.545903:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226535936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863682.545932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863682.545958:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226536320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863682.545979:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863682.546016:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536064 00000100:00100000:2.0:1788863682.546021:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536064 00010000:00010000:2.0:1788863682.546047:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 24 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863682.546071:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226535936 00000100:00100000:2.0:1788863682.546090:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226535936 00010000:00010000:2.0:1788863682.546102:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 25 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863682.546116:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536320 00000100:00100000:2.0:1788863682.546118:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536320 00010000:00010000:2.0:1788863682.546127:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 26 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863682.546152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788863682.546159:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+26:3642:x1875759226536064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863682.546171:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863682.546176:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 26 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.546185:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 26 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.546212:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863682.546237:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+26:3642:x1875759226536064:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863682.546244:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788863682.546259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788863682.546265:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3641:x1875759226535936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863682.546272:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863682.546276:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 25 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.546284:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 25 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.546293:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863682.546316:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+25:3641:x1875759226535936:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863682.546322:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788863682.546333:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863682.546345:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226536320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863682.546353:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863682.546357:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 24 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.546365:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 24 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.546374:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863682.546399:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226536320:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863682.546404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863682.548893:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226536064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863682.548940:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863682.548952:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226536192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863682.549026:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863682.549200:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226535936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863682.549228:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536192 00000100:00100000:2.0:1788863682.549234:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536192 00010000:00010000:2.0:1788863682.549269:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 24 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863682.549300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788863682.549307:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226536192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863682.549320:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863682.549324:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 24 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.549332:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 24 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.549349:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863682.549384:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226536192:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863682.549397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788863682.549430:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226536192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863682.549769:0:13752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114c00/0xf569beb9d4b68e7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68e73 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.549783:0:13752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535424:0@lo:104: 00010000:00010000:0.0:1788863682.549804:0:13752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d90200/0xf569beb9d4b68e6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68e65 expref: 22 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.549814:0:13752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535552:0@lo:104: 00010000:00010000:0.0:1788863682.549823:0:13752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114a00/0xf569beb9d4b68e5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68e57 expref: 21 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.549830:0:13752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535680:0@lo:104: 00010000:00010000:0.0:1788863682.549839:0:13752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114600/0xf569beb9d4b68e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b68e49 expref: 20 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863682.549849:0:13752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535808:0@lo:104: 00010000:00010000:0.0:1788863682.549888:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863682.550340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226536320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863682.554824:0:13752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535168:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863682.555315:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863682.555394:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205477120 00000100:00100000:3.0:1788863682.555403:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205477120 00010000:00010000:3.0:1788863682.555497:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 13 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863682.555610:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:3.0:1788863682.555622:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205477120:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863682.555639:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863682.555645:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 13 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.555657:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 13 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.555676:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b68e88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e3a expref: 13 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.555690:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863682.555753:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed3e4520-177d-4764-9911-f67f7853934a+12:2408:x1875759205477120:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 135us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863682.555760:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:0.0:1788863682.557154:0:13752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13752:1875759226535296:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863682.557302:0:13752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863682.560192:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863682.560420:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205477248 00000100:00100000:3.0:1788863682.560431:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205477248 00010000:00010000:3.0:1788863682.560652:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863682.560697:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:3.0:1788863682.560707:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed3e4520-177d-4764-9911-f67f7853934a+12:2409:x1875759205477248:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863682.560721:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863682.560736:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.560748:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.561387:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b68e81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e33 expref: 12 pid: 6532 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.561406:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863682.561414:0:10355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561502:0:10355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561511:0:10355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561517:0:10355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561524:0:10355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561541:0:10355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863682.561545:0:10355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561554:0:10355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561574:0:10355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863682.561586:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863682.561608:0:13752:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.561616:0:13752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863682.561621:0:13752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d91200/0xf569beb9d4b68fc3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863682.561649:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed3e4520-177d-4764-9911-f67f7853934a+11:2409:x1875759205477248:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 944us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863682.561669:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00010000:00010000:3.0:1788863682.731674:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788863683.542064:0:13801:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc515fc390 20000000:00000080:2.0:1788863683.543586:0:13801:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e543bf7c00 uarg=0000000000000000 20000000:01000000:2.0:1788863683.543634:0:13801:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788863683.543639:0:13801:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788863683.543645:0:13801:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788863683.545575:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788863683.550720:0:13801:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788863683.550852:0:13801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788863683.550886:0:13801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788863683.550899:0:13801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788863683.550911:0:13801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788863683.550934:0:13801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.550950:0:13801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.550983:0:13801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.550990:0:13801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.550998:0:13801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.551005:0:13801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.551011:0:13801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863683.551015:0:13801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.551023:0:13801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.551035:0:13801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.551043:0:13801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.551050:0:13801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fca lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863683.567004:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863683.567026:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226536448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863683.567119:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.567325:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863683.567335:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226536576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863683.567372:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.567408:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536448 00000100:00100000:3.0:1788863683.567416:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536448 00000100:00100000:3.0:1788863683.567462:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536576 00000100:00100000:3.0:1788863683.567465:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536576 00000100:00100000:2.0:1788863683.568912:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788863683.568928:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226536448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863683.568960:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863683.569034:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226536448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863683.569040:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788863683.569059:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788863683.569066:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226536576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863683.569091:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863683.569114:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226536576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863683.569120:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788863683.578232:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226536448:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788863683.578285:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863683.578328:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226536576:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788863683.627202:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863683.627209:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67aeee000 from 7 10000000:01000000:0.0:1788863683.627220:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863683.627269:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.627281:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.627293:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863683.627321:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226536704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.627393:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863683.627454:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863683.627550:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536704 00000100:00100000:3.0:1788863683.627559:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536704 00000100:00100000:3.0:1788863683.627613:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788863683.627623:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:6534:x1875759226536704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863683.627637:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863683.627650:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68fd1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.627674:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68fd1 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.627685:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68fd1 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.627694:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030400, rc 0) 00000100:00100000:3.0:1788863683.627736:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226536704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863683.627743:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788863683.627787:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226536704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863683.627800:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.627808:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863683.627881:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226536832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.627907:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.627922:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5425776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.627989:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536832 00000100:00100000:0.0:1788863683.627993:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536832 00000100:00100000:0.0:1788863683.628022:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788863683.628029:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226536832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.628150:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226536832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.628157:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788863683.628233:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226536832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.628261:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226536960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.628302:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.628332:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5425776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.628384:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226536960 00000100:00100000:0.0:1788863683.628387:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226536960 00000100:00100000:0.0:1788863683.628445:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788863683.628451:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226536960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.628521:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226536960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.628528:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788863683.631637:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226536960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.631854:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13809:1875759226537088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863683.631926:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.631957:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537088 00000100:00100000:3.0:1788863683.631963:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537088 00000100:00100000:3.0:1788863683.632007:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788863683.632016:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:13809:x1875759226537088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863683.632130:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:13809:x1875759226537088:12345-0@lo:502:llog_process_th.0 Request processed in 114us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863683.632138:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788863683.632188:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863683.632203:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13809:1875759226537088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863683.632223:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863683.632232:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.632235:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863683.632242:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e67aeee000 00000020:00000080:3.0:1788863683.632248:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863683.632305:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863683.632308:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.632310:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863683.632313:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863683.632315:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.632316:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788863683.632319:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e67aeee000 00000020:00000080:3.0:1788863683.632321:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863683.632349:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13809:1875759226537216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863683.632376:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.632391:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537216 00000100:00100000:3.0:1788863683.632394:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537216 00000100:00100000:3.0:1788863683.632408:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788863683.632413:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:13809:x1875759226537216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863683.632460:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:13809:x1875759226537216:12345-0@lo:502:llog_process_th.0 Request processed in 46us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863683.632466:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788863683.632490:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863683.632501:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13809:1875759226537216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863683.632518:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863683.632522:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.632523:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788863683.632527:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788863683.632580:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788863683.632597:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863683.632605:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.632625:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863683.632634:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863683.632637:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67afa4000 from 7 10000000:01000000:3.0:1788863683.632639:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863683.632661:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.632669:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.632679:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863683.632691:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.632714:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.632725:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863683.632735:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537344 00000100:00100000:3.0:1788863683.632738:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537344 00000100:00100000:3.0:1788863683.632751:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788863683.632756:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:6534:x1875759226537344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863683.632764:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863683.632775:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031600/0xf569beb9d4b68fe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68fdf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.632795:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031600/0xf569beb9d4b68fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68fdf expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.632817:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031600/0xf569beb9d4b68fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68fdf expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.632825:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031600, rc 0) 00000100:00100000:3.0:1788863683.632852:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226537344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863683.632858:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788863683.632887:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863683.632899:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.632906:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863683.632946:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.632984:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.632997:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863683.633007:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537472 00000100:00100000:3.0:1788863683.633010:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537472 00000100:00100000:3.0:1788863683.633024:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788863683.633028:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226537472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.633133:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226537472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863683.633139:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788863683.633164:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.633195:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.633231:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.633244:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863683.633254:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537600 00000100:00100000:3.0:1788863683.633258:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537600 00000100:00100000:3.0:1788863683.633273:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788863683.633278:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226537600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.633342:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226537600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863683.633348:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788863683.633377:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.645587:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13810:1875759226537728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863683.645672:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863683.647961:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788863683.653592:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537728 00000100:00100000:1.0:1788863683.653609:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537728 00000100:00100000:1.0:1788863683.653672:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788863683.653682:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:13810:x1875759226537728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863683.653874:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:13810:x1875759226537728:12345-0@lo:502:llog_process_th.0 Request processed in 192us (8201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863683.653883:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788863683.654035:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13810:1875759226537728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863683.654104:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863683.654115:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863683.654117:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788863683.654125:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e67afa4000 00000020:00000080:0.0:1788863683.654127:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788863683.654195:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863683.654199:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863683.654201:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788863683.654203:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863683.654206:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863683.654207:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788863683.654211:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e67afa4000 00000020:00000080:0.0:1788863683.654213:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788863683.654262:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13810:1875759226537856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863683.654306:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863683.654333:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537856 00000100:00100000:0.0:1788863683.654337:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537856 00000100:00100000:0.0:1788863683.654361:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788863683.654367:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:13810:x1875759226537856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863683.654434:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:13810:x1875759226537856:12345-0@lo:502:llog_process_th.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.654441:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788863683.654486:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e650387540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.654499:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13810:1875759226537856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863683.654515:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863683.654524:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863683.654525:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788863683.654529:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788863683.654798:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788863683.654821:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863683.654831:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.654841:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863683.654851:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863683.654854:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e648f4b800 from 7 10000000:01000000:3.0:1788863683.654857:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863683.654884:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.654892:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863683.654913:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863683.654927:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.654957:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.655307:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.661987:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226537984 00000100:00100000:0.0:1788863683.662003:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226537984 00000100:00100000:0.0:1788863683.662166:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788863683.662177:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:6534:x1875759226537984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863683.662197:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863683.662218:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68ff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68fed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.662248:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68fed expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.662260:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68fed expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.662269:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d91c00, rc 0) 00000100:00100000:0.0:1788863683.662347:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226537984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (7389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.662355:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788863683.662400:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226537984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863683.662418:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.662428:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863683.662501:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.662548:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863683.662580:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e650387540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.662598:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226538112 00000100:00100000:0.0:1788863683.662602:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226538112 00000100:00100000:0.0:1788863683.662617:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788863683.662622:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226538112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.662732:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226538112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.662738:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788863683.662760:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.662787:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.662826:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863683.662836:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e650387540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.662851:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226538240 00000100:00100000:0.0:1788863683.662855:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226538240 00000100:00100000:0.0:1788863683.662870:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788863683.662876:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226538240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.662949:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226538240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.662956:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788863683.663003:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863683.663522:0:13816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13816:1875759226538368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863683.663565:0:13816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.663584:0:13816:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.663622:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226538368 00000100:00100000:0.0:1788863683.663627:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226538368 00000100:00100000:0.0:1788863683.663660:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788863683.663666:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:13816:x1875759226538368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863683.663744:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:13816:x1875759226538368:12345-0@lo:502:llog_process_th.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.663751:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000040:00080000:0.0:1788863683.664368:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788863683.664493:0:13816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13816:1875759226538368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863683.664522:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863683.664532:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.664535:0:13816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863683.664542:0:13816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e648f4b800 00000020:00000080:3.0:1788863683.664544:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863683.664610:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863683.664614:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.664615:0:13816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863683.664618:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863683.664621:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.664622:0:13816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788863683.664625:0:13816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e648f4b800 00000020:00000080:3.0:1788863683.664627:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863683.664668:0:13816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13816:1875759226538496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863683.664718:0:13816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863683.664742:0:13816:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863683.668732:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226538496 00000100:00100000:3.0:1788863683.668760:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226538496 00000100:00100000:3.0:1788863683.668823:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788863683.668832:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:13816:x1875759226538496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863683.669018:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:13816:x1875759226538496:12345-0@lo:502:llog_process_th.0 Request processed in 187us (4300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863683.669026:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788863683.669096:0:13816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13816:1875759226538496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863683.669124:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863683.669131:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863683.669134:0:13816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788863683.669138:0:13816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788863683.678140:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788863683.678183:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863683.678195:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.678209:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863683.678222:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863683.678224:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e64a89a800 from 7 10000000:01000000:0.0:1788863683.678228:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863683.678270:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.678277:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.678288:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863683.678316:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.678400:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863683.678445:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6507eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.678480:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226538624 00000100:00100000:0.0:1788863683.678487:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226538624 00000100:00100000:0.0:1788863683.678543:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788863683.678550:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:6534:x1875759226538624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863683.678562:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863683.678573:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d90200/0xf569beb9d4b69002 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b68ffb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.678595:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d90200/0xf569beb9d4b69002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b68ffb expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.678606:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d90200/0xf569beb9d4b69002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b68ffb expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.678614:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90200, rc 0) 00000100:00100000:0.0:1788863683.678647:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226538624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.678655:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788863683.678696:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863683.678709:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.678718:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863683.678767:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.678787:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863683.685171:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6507eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.685228:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226538752 00000100:00100000:0.0:1788863683.685238:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226538752 00000100:00100000:0.0:1788863683.685310:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788863683.685319:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226538752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.685666:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226538752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (6875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.685676:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788863683.685764:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863683.685817:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863683.685864:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863683.685888:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.685930:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226538880 00000100:00100000:0.0:1788863683.685936:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226538880 00000100:00100000:0.0:1788863683.685978:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788863683.685985:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226538880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863683.686057:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:6534:x1875759226538880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.686063:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788863683.686199:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:6534:1875759226538880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863683.690807:0:13820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13820:1875759226539008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863683.690898:0:13820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863683.690950:0:13820:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.691015:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539008 00000100:00100000:0.0:1788863683.691023:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539008 00000100:00100000:0.0:1788863683.691096:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788863683.691106:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:13820:x1875759226539008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863683.691235:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:13820:x1875759226539008:12345-0@lo:502:llog_process_th.0 Request processed in 131us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.691243:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788863683.692204:0:13820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13820:1875759226539008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863683.692238:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863683.692248:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863683.692250:0:13820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788863683.692261:0:13820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e64a89a800 00000020:00000080:1.0:1788863683.692270:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788863683.692346:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863683.692350:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863683.692352:0:13820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788863683.692356:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863683.692359:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863683.692360:0:13820:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788863683.692363:0:13820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e64a89a800 00000020:00000080:1.0:1788863683.692378:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788863683.692425:0:13820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13820:1875759226539136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863683.692479:0:13820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863683.692509:0:13820:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863683.692604:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539136 00000100:00100000:0.0:1788863683.692610:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539136 00000100:00100000:0.0:1788863683.692651:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788863683.692659:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:13820:x1875759226539136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863683.692747:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:13820:x1875759226539136:12345-0@lo:502:llog_process_th.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863683.692755:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788863683.692831:0:13820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:13820:1875759226539136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863683.692848:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863683.692851:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863683.692853:0:13820:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788863683.692857:0:13820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788863683.701512:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788863683.701553:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863683.701566:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863683.701581:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863683.704495:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788863683.759586:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863684.075551:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226539392:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.075634:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863684.075761:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226539264:0@lo:400:kworker.0 00000100:00100000:1.0:1788863684.075798:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863684.075864:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539392 00000100:00100000:1.0:1788863684.075872:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539392 00000100:00100000:1.0:1788863684.075921:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788863684.075930:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226539392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.076123:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226539520:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.076156:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863684.076187:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539520 00000100:00100000:3.0:1788863684.076191:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539520 00000100:00100000:3.0:1788863684.076218:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788863684.076224:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226539520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.076261:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226539520:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.076268:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788863684.076319:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226539520:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.076353:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539264 00000100:00100000:3.0:1788863684.076356:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539264 00000100:00100000:3.0:1788863684.076383:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788863684.076389:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226539264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.076437:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226539264:12345-0@lo:400:kworker.0 Request processed in 48us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.076443:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788863684.076489:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226539264:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.080421:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863684.080469:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863684.080498:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863684.080518:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863684.080539:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863684.081690:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205477376 00000100:00100000:0.0:1788863684.081703:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205477376 00000100:00100000:0.0:1788863684.081764:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 361 00000100:00100000:0.0:1788863684.081774:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+11:2411:x1875759205477376:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863684.081866:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226539392:12345-0@lo:400:kworker.0 Request processed in 5935us (6230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.081877:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788863684.081904:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205477632 00000100:00100000:1.0:1788863684.081908:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205477632 00000100:00080000:1.0:1788863684.081931:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863684.081992:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205477888 00000100:00100000:1.0:1788863684.081997:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205477888 00000100:00100000:1.0:1788863684.082015:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205477504 00000100:00100000:1.0:1788863684.082018:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205477504 00000100:00100000:1.0:1788863684.082034:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00100000:1.0:1788863684.082041:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205477632:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863684.082134:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205477632:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 93us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.082141:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00100000:1.0:1788863684.082154:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:1.0:1788863684.082160:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205477888:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863684.082182:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205477888:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.082188:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:1.0:1788863684.082199:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00100000:1.0:1788863684.082204:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205477504:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863684.082224:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205477504:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 20us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.082230:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00080000:1.0:1788863684.082242:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863684.082466:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+11:2411:x1875759205477376:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 693us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.082473:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 361 00000100:00100000:1.0:1788863684.083681:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226539392:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.086786:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863684.087296:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205477760 00000100:00100000:0.0:1788863684.087307:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205477760 00000100:00100000:0.0:1788863684.087387:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:0.0:1788863684.087397:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205477760:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863684.087467:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205477760:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 71us (6926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.087475:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:1.0:1788863684.087692:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478016 00000100:00100000:1.0:1788863684.087696:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478016 00000100:00100000:1.0:1788863684.087737:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00100000:1.0:1788863684.087746:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205478016:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863684.087803:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205478016:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 59us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.087810:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00080000:3.0:1788863684.088200:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863684.088205:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863684.088486:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226539776:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.088536:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863684.088583:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226540288:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.088612:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863684.088628:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226540800:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.088648:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863684.088692:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788863684.088698:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226539648:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.088721:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863684.088736:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226540160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.088762:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863684.088777:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226540672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.088793:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863684.088817:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540288 00000100:00100000:0.0:1788863684.088822:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540288 00000100:00100000:0.0:1788863684.088851:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540800 00000100:00100000:0.0:1788863684.088853:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540800 00000100:00100000:0.0:1788863684.088865:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540160 00000100:00100000:0.0:1788863684.088867:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540160 00000100:00100000:0.0:1788863684.088877:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540672 00000100:00100000:0.0:1788863684.088879:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540672 00000100:00100000:0.0:1788863684.088893:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788863684.088899:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226540288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.088937:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226540288:12345-0@lo:400:kworker.0 Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.088942:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788863684.089241:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788863684.089249:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226540800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.089277:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226540800:12345-0@lo:400:kworker.0 Request processed in 30us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.089289:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788863684.089300:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788863684.089305:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226540160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.089332:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226540160:12345-0@lo:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.089336:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788863684.089346:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788863684.089351:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226540672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.089373:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226540672:12345-0@lo:400:kworker.0 Request processed in 21us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.089378:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788863684.089395:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539648 00000100:00100000:0.0:1788863684.089399:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539648 00000100:00100000:0.0:1788863684.089424:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788863684.089430:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226539648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.089458:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226539648:12345-0@lo:400:kworker.0 Request processed in 29us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.089463:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788863684.089501:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226539648:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.089511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226540160:0@lo:400:kworker.0 00010000:00080000:0.0:1788863684.089523:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af5b800 x1875759226540672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863684.089531:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226540672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863684.089540:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226540288:0@lo:400:kworker.0 00010000:00080000:0.0:1788863684.089557:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af5a300 x1875759226540800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863684.089564:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226540800:0@lo:400:kworker.0 00000100:00080000:3.0:1788863684.089660:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863684.089664:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863684.089691:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226540032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.089722:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863684.089750:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226540544:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.089770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863684.089789:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788863684.089795:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226539904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.089813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863684.089826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226540416:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.089845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863684.089867:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540032 00000100:00100000:3.0:1788863684.089870:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540032 00000100:00100000:3.0:1788863684.089896:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540544 00000100:00100000:3.0:1788863684.089905:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540544 00000100:00100000:3.0:1788863684.089921:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539904 00000100:00100000:3.0:1788863684.089924:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539904 00000100:00100000:3.0:1788863684.089935:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540416 00000100:00100000:3.0:1788863684.089937:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540416 00000100:00100000:3.0:1788863684.089950:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788863684.089972:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226540032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.090196:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226540032:12345-0@lo:400:kworker.0 Request processed in 239us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.090202:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788863684.090216:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788863684.090222:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226540544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.090247:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226540544:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.090252:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788863684.090264:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788863684.090280:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226539904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.090305:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226539904:12345-0@lo:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.090310:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788863684.090322:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788863684.090327:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226540416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.090351:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226540416:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.090356:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1788863684.090370:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863684.090373:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863684.090403:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226539904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.090412:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226540416:0@lo:400:kworker.0 00010000:00080000:3.0:1788863684.090421:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af56300 x1875759226540032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863684.090428:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226540032:0@lo:400:kworker.0 00010000:00080000:3.0:1788863684.090436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af59880 x1875759226540544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863684.090443:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226540544:0@lo:400:kworker.0 00000100:00100000:2.0:1788863684.090529:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226539776 00000100:00100000:2.0:1788863684.090534:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226539776 00000100:00100000:2.0:1788863684.090568:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788863684.090575:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226539776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863684.090617:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226539776:12345-0@lo:400:kworker.0 Request processed in 43us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863684.090632:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788863684.090660:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226539776:0@lo:400:kworker.0 00000100:00100000:3.0:1788863684.335574:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863684.339262:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478144 00000100:00100000:0.0:1788863684.339277:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478144 00000100:00100000:0.0:1788863684.339362:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 362 00000100:00100000:0.0:1788863684.339373:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+11:6188:x1875759205478144:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863684.339390:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863684.339407:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d90a00/0xf569beb9d4b69009 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e87 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863684.339433:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d90a00/0xf569beb9d4b69009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e87 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863684.339444:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d90a00/0xf569beb9d4b69009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e87 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863684.339453:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90a00, rc 0) 00000100:00100000:0.0:1788863684.339692:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205478144:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 319us (4127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.339699:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 362 00000100:00100000:1.0:1788863684.349666:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863684.349768:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478272 00000100:00100000:0.0:1788863684.349779:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478272 00000100:00100000:0.0:1788863684.349837:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 363 00000100:00100000:0.0:1788863684.349857:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205478272:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863684.350011:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205478272:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 165us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.350033:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 363 00000100:00100000:1.0:1788863684.355700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863684.355871:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478400 00000100:00100000:0.0:1788863684.355881:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478400 00000100:00100000:0.0:1788863684.355939:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 364 00000100:00100000:0.0:1788863684.355948:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205478400:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863684.356136:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205478400:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 188us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.356145:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 364 00000100:00100000:3.0:1788863684.368065:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863684.368727:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478528 00000100:00100000:1.0:1788863684.368738:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478528 00000100:00100000:1.0:1788863684.368800:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 365 00000100:00100000:1.0:1788863684.368810:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+12:10797:x1875759205478528:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863684.369158:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+12:10797:x1875759205478528:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 348us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.369166:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 365 00000100:00100000:1.0:1788863684.381392:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863684.381585:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478656 00000100:00100000:3.0:1788863684.381605:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478656 00000100:00100000:3.0:1788863684.381661:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 366 00000100:00100000:3.0:1788863684.381672:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+12:10797:x1875759205478656:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788863684.381895:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+12:10797:x1875759205478656:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 224us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.381905:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 366 00000100:00100000:2.0:1788863684.392598:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863684.394196:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478784 00000100:00100000:0.0:1788863684.394210:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478784 00000100:00100000:0.0:1788863684.394281:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 367 00000100:00100000:0.0:1788863684.394291:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+12:6188:x1875759205478784:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863684.394309:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863684.394328:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b69010 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e8e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863684.394358:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b69010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e8e expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863684.394369:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b69010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e8e expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863684.394378:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d91e00, rc 0) 00000100:00100000:0.0:1788863684.394456:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205478784:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 166us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.394463:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 367 00000100:00100000:0.0:1788863684.397439:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863684.397601:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205478912 00000100:00100000:1.0:1788863684.397611:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205478912 00000100:00100000:1.0:1788863684.397661:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 368 00000100:00100000:1.0:1788863684.397779:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205478912:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863684.398119:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205478912:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 345us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.398128:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 368 00000100:00100000:1.0:1788863684.406176:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863684.406332:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479040 00000100:00100000:3.0:1788863684.406342:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479040 00000100:00100000:3.0:1788863684.406399:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 369 00000100:00100000:3.0:1788863684.406408:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205479040:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863684.406563:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:6188:x1875759205479040:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 155us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.406571:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 369 00000100:00100000:2.0:1788863684.411048:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863684.411230:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479168 00000100:00100000:0.0:1788863684.411243:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479168 00000100:00100000:0.0:1788863684.411305:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 370 00000100:00100000:0.0:1788863684.411316:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:10800:x1875759205479168:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863684.411631:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:10800:x1875759205479168:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 151us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863684.411641:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 370 00000100:00100000:0.0:1788863684.426876:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863684.427001:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479296 00000100:00100000:1.0:1788863684.427011:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479296 00000100:00100000:1.0:1788863684.427069:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 371 00000100:00100000:1.0:1788863684.427106:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:10800:x1875759205479296:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863684.427803:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:10800:x1875759205479296:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 696us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863684.427813:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 371 00000100:00100000:0.0:1788863684.587524:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226540928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863684.587534:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226541056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863684.587608:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863684.588361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863684.588472:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541056 00000100:00100000:3.0:1788863684.588480:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541056 00000100:00100000:3.0:1788863684.588513:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226540928 00000100:00100000:3.0:1788863684.588516:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226540928 00000100:00100000:3.0:1788863684.588530:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788863684.588536:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226541056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863684.588566:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863684.588628:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226541056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.588636:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788863684.588652:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788863684.588659:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226540928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863684.588685:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863684.588731:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226540928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863684.588736:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1788863684.590060:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54408c380 x1875759226541056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863684.590127:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226541056:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788863684.591433:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af5aa00 x1875759226540928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863684.591469:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226540928:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788863684.716540:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788863684.717318:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863684.779513:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863685.099543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226541184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863685.099624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863685.099764:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541184 00000100:00100000:0.0:1788863685.099773:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541184 00000100:00100000:0.0:1788863685.099831:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788863685.099840:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226541184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863685.099882:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863685.099949:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226541184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863685.099956:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788863685.100850:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226541184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863685.101989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226541312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863685.102066:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863685.105470:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541312 00000100:00100000:1.0:1788863685.105489:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541312 00000100:00100000:1.0:1788863685.105571:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788863685.105581:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226541312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863685.105642:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788863685.105749:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226541312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863685.105757:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788863685.105841:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226541312:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788863685.803281:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863686.828891:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788863687.664238:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1788863687.852877:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863688.683951:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226541440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863688.684054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863688.684189:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863688.684196:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226541568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863688.684224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863688.684328:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541440 00000100:00100000:3.0:1788863688.684338:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541440 00000100:00100000:3.0:1788863688.684405:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541568 00000100:00100000:3.0:1788863688.684409:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541568 00000100:00100000:3.0:1788863688.684426:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788863688.684437:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226541440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863688.684476:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863688.684553:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226541440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863688.684560:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788863688.684600:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788863688.684607:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226541568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863688.684618:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863688.684642:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226541568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863688.684648:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788863688.684687:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788863688.684693:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e541ef7480, transno 4294967301 00000100:00100000:3.0:1788863688.684714:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226541568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863688.684732:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226541440:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788863688.685792:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788863688.875645:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863689.198903:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226541696:0@lo:400:kworker.0 00000100:00100000:2.0:1788863689.199014:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863689.199508:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226541824:0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.199558:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863689.199637:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541824 00000100:00100000:3.0:1788863689.199649:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541824 00000100:00100000:3.0:1788863689.199763:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788863689.199773:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226541824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.199837:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226541824:12345-0@lo:400:kworker.0 Request processed in 65us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.199845:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788863689.199916:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226541824:0@lo:400:kworker.0 00000100:00100000:0.0:1788863689.200414:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541696 00000100:00100000:0.0:1788863689.200424:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541696 00000100:00100000:0.0:1788863689.200477:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788863689.200486:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226541696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.200703:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863689.200758:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863689.200797:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863689.200827:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863689.200851:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863689.200894:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863689.200917:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479552 00000100:00100000:3.0:1788863689.200921:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479552 00000100:00100000:3.0:1788863689.200960:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480064 00000100:00100000:3.0:1788863689.200963:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480064 00000100:00100000:3.0:1788863689.200976:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479680 00000100:00100000:3.0:1788863689.200978:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479680 00000100:00100000:3.0:1788863689.200991:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479936 00000100:00100000:3.0:1788863689.200994:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479936 00000100:00100000:3.0:1788863689.201008:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:3.0:1788863689.201015:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205479552:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863689.201101:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205479552:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 61us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.201109:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:3.0:1788863689.201127:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 246 00000100:00100000:3.0:1788863689.201134:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205480064:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863689.201176:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205480064:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 43us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.201182:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 246 00000100:00100000:3.0:1788863689.201194:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:3.0:1788863689.201199:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205479680:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863689.201222:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205479680:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.201240:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:3.0:1788863689.201251:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 248 00000100:00100000:3.0:1788863689.201257:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205479936:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863689.201284:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205479936:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.201289:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 248 00000100:00100000:3.0:1788863689.201308:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479808 00000100:00100000:3.0:1788863689.201312:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479808 00000100:00100000:3.0:1788863689.201346:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 92 00000100:00100000:3.0:1788863689.201352:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205479808:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863689.201382:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205479808:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.201388:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 92 00000100:00080000:3.0:1788863689.201411:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863689.201417:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863689.201419:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863689.201609:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205479424 00000100:00100000:3.0:1788863689.201613:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205479424 00000100:00100000:3.0:1788863689.201640:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 373 00000100:00100000:3.0:1788863689.201647:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205479424:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863689.201685:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205479424:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 38us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.201691:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 373 00000100:00100000:1.0:1788863689.210734:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.210841:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863689.210875:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226541952:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.210897:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226542592:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.210930:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863689.210931:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863689.210959:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226542464:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.210959:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226543104:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.210980:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863689.210991:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863689.211007:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226542976:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211024:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542592 00000100:00100000:3.0:1788863689.211026:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863689.211033:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542592 00000100:00100000:3.0:1788863689.211056:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542080 00000100:00100000:3.0:1788863689.211060:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542080 00000100:00100000:1.0:1788863689.211106:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226543104 00000100:00100000:3.0:1788863689.211108:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542464 00000100:00100000:3.0:1788863689.211110:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542464 00000100:00100000:1.0:1788863689.211116:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226543104 00000100:00100000:3.0:1788863689.211149:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542976 00000100:00100000:3.0:1788863689.211152:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542976 00000100:00100000:1.0:1788863689.211298:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788863689.211309:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226542592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211377:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226542592:12345-0@lo:400:kworker.0 Request processed in 69us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863689.211385:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788863689.211406:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788863689.211413:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226543104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211441:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226543104:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863689.211447:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788863689.211493:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226542592:0@lo:400:kworker.0 00010000:00080000:1.0:1788863689.211508:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d6a00 x1875759226543104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863689.211519:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226543104:0@lo:400:kworker.0 00000100:00080000:1.0:1788863689.211552:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863689.211557:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863689.211572:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226542336:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211601:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863689.211616:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226542848:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211634:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863689.211649:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788863689.211655:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863689.211714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226542720:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211746:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863689.211763:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226543232:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211784:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863689.211810:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226541952 00000100:00100000:1.0:1788863689.211815:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226541952 00000100:00100000:1.0:1788863689.211841:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542208 00000100:00100000:1.0:1788863689.211844:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542208 00000100:00100000:3.0:1788863689.211855:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542336 00000100:00100000:1.0:1788863689.211868:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863689.211869:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542336 00000100:00100000:1.0:1788863689.211874:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226541952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.211892:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542848 00000100:00100000:3.0:1788863689.211895:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542848 00000100:00100000:3.0:1788863689.211911:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788863689.211914:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226541952:12345-0@lo:400:kworker.0 Request processed in 41us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.211917:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226542080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.211921:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788863689.211932:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788863689.211937:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226542208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.211957:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226542080:12345-0@lo:400:kworker.0 Request processed in 40us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.211964:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788863689.211966:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226542208:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863689.211971:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788863689.211987:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226542720 00000100:00100000:3.0:1788863689.211989:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788863689.211990:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226542720 00000100:00100000:3.0:1788863689.211995:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226542464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.212007:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226543232 00000100:00100000:1.0:1788863689.212010:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226543232 00000100:00100000:3.0:1788863689.212024:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226542464:12345-0@lo:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863689.212024:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788863689.212030:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788863689.212030:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226542720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.212040:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788863689.212045:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226542976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.212056:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226542720:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863689.212062:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788863689.212072:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788863689.212102:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226542976:12345-0@lo:400:kworker.0 Request processed in 57us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863689.212106:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226543232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.212120:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788863689.212134:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788863689.212135:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226543232:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.212139:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226542336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863689.213327:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e642db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226541696:12345-0@lo:400:kworker.0 Request processed in 12833us (14303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863689.213344:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:0.0:1788863689.213552:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863689.213559:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863689.213587:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788863689.213602:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226542848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863689.213672:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226542848:12345-0@lo:400:kworker.0 Request processed in 77us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863689.213693:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788863689.213726:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226542336:12345-0@lo:400:kworker.0 Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863689.213735:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788863689.213757:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226542208:0@lo:400:kworker.0 00000100:00100000:0.0:1788863689.213772:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226542720:0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.213773:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226542080:0@lo:400:kworker.0 00010000:00080000:0.0:1788863689.213789:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d4700 x1875759226543232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863689.213821:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226543232:0@lo:400:kworker.0 00000100:00100000:0.0:1788863689.213837:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226542336:0@lo:400:kworker.0 00000100:00100000:3.0:1788863689.213845:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226541952:0@lo:400:kworker.0 00000100:00100000:0.0:1788863689.213848:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226542848:0@lo:400:kworker.0 00010000:00080000:3.0:1788863689.213871:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54408d500 x1875759226542464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863689.213881:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226542464:0@lo:400:kworker.0 00010000:00080000:3.0:1788863689.213895:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d5f80 x1875759226542976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863689.213903:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226542976:0@lo:400:kworker.0 00000100:00100000:2.0:1788863689.214388:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226541696:0@lo:400:kworker.0 00000100:00100000:1.0:1788863689.214879:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788863689.707598:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226543360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863689.707715:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863689.708360:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226543360 00000100:00100000:1.0:1788863689.708372:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226543360 00000100:00100000:1.0:1788863689.708448:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788863689.708460:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226543360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863689.708510:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863689.708584:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226543360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863689.708592:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788863689.708996:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226543488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863689.709042:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863689.709162:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226543488 00000100:00100000:0.0:1788863689.709168:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226543488 00000100:00100000:0.0:1788863689.709195:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788863689.709201:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226543488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863689.709214:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863689.709256:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226543488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863689.709262:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788863689.709305:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543925880 x1875759226543360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863689.709327:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226543360:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788863689.709406:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af58a80 x1875759226543488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863689.709418:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226543488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788863689.899520:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863690.220399:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863690.220433:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226543616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863690.220535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863690.220734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863690.220746:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226543744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863690.220782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863690.220816:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226543616 00000100:00100000:0.0:1788863690.220825:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226543616 00000100:00100000:0.0:1788863690.220890:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226543744 00000100:00100000:0.0:1788863690.220894:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226543744 00000100:00100000:0.0:1788863690.220931:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788863690.220962:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226543616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863690.221013:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863690.221066:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226543616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863690.221098:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788863690.221120:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788863690.221127:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226543744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863690.221147:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788863690.221182:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226543744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863690.221189:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788863690.221236:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226543744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863690.221578:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226543616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788863690.928000:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863691.947345:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863692.971999:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863693.804050:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226543872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863693.804189:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863693.804424:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226543872 00000100:00100000:1.0:1788863693.804435:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226543872 00000100:00100000:1.0:1788863693.804511:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788863693.804523:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226543872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863693.804561:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863693.804617:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226543872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863693.804625:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788863693.805587:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863693.805670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226543872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863693.805842:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863693.805861:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226544000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863693.805938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863693.805986:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544000 00000100:00100000:3.0:1788863693.805993:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544000 00000100:00100000:3.0:1788863693.806061:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788863693.806071:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226544000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863693.806114:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863693.806161:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226544000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863693.806169:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788863693.806191:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863693.806216:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226544000:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863694.003544:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863694.315614:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226544384:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.315688:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.315905:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226544896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.315934:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.315953:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226545408:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.315974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.315999:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788863694.316006:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226544256:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.316026:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.316043:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226544768:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.316063:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.316116:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226545280:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.316139:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.316174:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544384 00000100:00100000:3.0:1788863694.316182:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544384 00000100:00100000:3.0:1788863694.316230:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788863694.316239:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226544384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.316310:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226544384:12345-0@lo:400:kworker.0 Request processed in 72us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863694.316319:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788863694.316508:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226544512:0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.316568:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544896 00000100:00100000:2.0:1788863694.316572:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544896 00000100:00100000:2.0:1788863694.316608:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545408 00000100:00100000:2.0:1788863694.316611:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545408 00000100:00100000:2.0:1788863694.316622:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544256 00000100:00100000:2.0:1788863694.316624:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544256 00000100:00100000:2.0:1788863694.316634:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544768 00000100:00100000:2.0:1788863694.316643:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544768 00000100:00100000:2.0:1788863694.316658:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545280 00000100:00100000:2.0:1788863694.316660:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545280 00000100:00100000:2.0:1788863694.316674:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788863694.316680:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226544896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.316715:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226544896:12345-0@lo:400:kworker.0 Request processed in 35us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.316721:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788863694.316734:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788863694.316739:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226545408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.316778:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226545408:12345-0@lo:400:kworker.0 Request processed in 38us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.316784:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788863694.316794:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788863694.316801:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226544256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.316828:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226544256:12345-0@lo:400:kworker.0 Request processed in 28us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.316834:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788863694.316845:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788863694.316850:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226544768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.316877:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226544768:12345-0@lo:400:kworker.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.316882:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788863694.316893:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788863694.316898:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226545280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.316922:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226545280:12345-0@lo:400:kworker.0 Request processed in 24us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.316934:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:2.0:1788863694.316961:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863694.316965:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863694.317017:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226544256:0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.317029:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226544768:0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.317039:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226545280:0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.317047:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226544384:0@lo:400:kworker.0 00010000:00080000:2.0:1788863694.317058:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543bf3100 x1875759226544896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863694.317067:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226544896:0@lo:400:kworker.0 00010000:00080000:2.0:1788863694.317101:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360d180 x1875759226545408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863694.317109:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226545408:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317218:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226544128:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863694.317296:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226544640:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317320:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863694.317340:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226545152:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863694.317554:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226545664:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863694.317626:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544640 00000100:00100000:0.0:1788863694.317630:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544640 00000100:00100000:0.0:1788863694.317660:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863694.317667:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226544640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317708:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226544640:12345-0@lo:400:kworker.0 Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863694.317715:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863694.317734:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545152 00000100:00100000:0.0:1788863694.317737:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545152 00000100:00100000:0.0:1788863694.317776:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545664 00000100:00100000:0.0:1788863694.317779:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545664 00000100:00100000:0.0:1788863694.317805:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788863694.317811:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226545152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317841:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226545152:12345-0@lo:400:kworker.0 Request processed in 30us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863694.317847:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788863694.317858:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788863694.317865:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226545664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317890:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226545664:12345-0@lo:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863694.317896:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788863694.317918:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863694.317943:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226544640:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.317953:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226545152:0@lo:400:kworker.0 00010000:00080000:0.0:1788863694.317963:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e541ef7480 x1875759226545664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863694.317979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226545664:0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.318110:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544128 00000100:00100000:2.0:1788863694.318116:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544128 00000100:00100000:2.0:1788863694.318143:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788863694.318150:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226544128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863694.318186:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226544128:12345-0@lo:400:kworker.0 Request processed in 36us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.318192:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788863694.318504:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226544128:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.318653:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863694.318706:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863694.318786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.318811:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863694.318819:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226545024:0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.318834:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863694.318847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863694.318889:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480320 00000100:00100000:2.0:1788863694.318894:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480320 00000100:00100000:2.0:1788863694.318927:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226544512 00000100:00100000:3.0:1788863694.318937:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863694.318938:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226544512 00000100:00100000:2.0:1788863694.318953:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480832 00000100:00100000:2.0:1788863694.318955:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480832 00000100:00100000:3.0:1788863694.318961:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863694.318967:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480448 00000100:00100000:2.0:1788863694.318970:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480448 00000100:00100000:3.0:1788863694.318978:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480704 00000100:00100000:3.0:1788863694.318981:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480704 00000100:00100000:2.0:1788863694.318983:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 259 00000100:00100000:2.0:1788863694.318988:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205480320:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863694.319000:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788863694.319006:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226544512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863694.319036:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226544512:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.319040:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205480320:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 51us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863694.319043:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788863694.319046:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 259 00000100:00100000:2.0:1788863694.319056:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 261 00000100:00100000:2.0:1788863694.319062:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205480832:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863694.319115:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205480832:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863694.320463:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 262 00000100:00100000:3.0:1788863694.320482:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205480448:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863694.320530:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205480448:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 58us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863694.320537:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 262 00000100:00100000:3.0:1788863694.320564:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 263 00000100:00100000:3.0:1788863694.320570:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205480704:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863694.320601:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205480704:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 32us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863694.320622:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 263 00000100:00080000:3.0:1788863694.320812:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863694.320818:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863694.320863:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480192 00000100:00100000:3.0:1788863694.320870:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480192 00000100:00100000:3.0:1788863694.320902:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 375 00000100:00100000:3.0:1788863694.320907:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205480192:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863694.320949:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e660385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205480192:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863694.320956:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 375 00000100:00100000:2.0:1788863694.322356:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 261 00000100:00100000:0.0:1788863694.323050:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226545536:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.323117:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863694.323229:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480576 00000100:00100000:1.0:1788863694.323237:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480576 00000100:00100000:1.0:1788863694.323288:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545024 00000100:00100000:1.0:1788863694.323291:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545024 00000100:00100000:1.0:1788863694.323314:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:1.0:1788863694.323322:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205480576:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863694.323401:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205480576:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 80us (4694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863694.323408:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:1.0:1788863694.323426:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788863694.323433:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226545024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863694.323467:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226545024:12345-0@lo:400:kworker.0 Request processed in 35us (4619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863694.323473:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788863694.323712:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863694.323827:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226544512:0@lo:400:kworker.0 00000100:00100000:0.0:1788863694.323840:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226545024:0@lo:400:kworker.0 00000100:00100000:1.0:1788863694.323973:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545536 00000100:00100000:1.0:1788863694.323978:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545536 00000100:00100000:1.0:1788863694.324055:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788863694.324062:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226545536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863694.324124:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226545536:12345-0@lo:400:kworker.0 Request processed in 63us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863694.324130:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1788863694.324202:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54360ed80 x1875759226545536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863694.324214:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226545536:0@lo:400:kworker.0 00000100:00080000:3.0:1788863694.324273:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863694.827543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226545792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863694.827640:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863694.827792:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545792 00000100:00100000:2.0:1788863694.827802:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545792 00000100:00100000:2.0:1788863694.827856:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788863694.827865:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226545792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863694.827897:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863694.827960:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226545792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863694.827967:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1788863694.830566:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af58e00 x1875759226545792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863694.830593:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226545792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863694.830641:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863694.830653:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226545920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863694.830716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863694.832379:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226545920 00000100:00100000:3.0:1788863694.832468:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226545920 00000100:00100000:3.0:1788863694.832543:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788863694.832556:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226545920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863694.832591:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863694.832693:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226545920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863694.832700:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788863694.832859:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4bbb80 x1875759226545920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863694.832882:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226545920:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788863694.955816:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788863694.957292:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788863695.019406:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863695.339342:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226546048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863695.339413:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863695.339536:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546048 00000100:00100000:0.0:1788863695.339545:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546048 00000100:00100000:0.0:1788863695.339599:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788863695.339608:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226546048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863695.339656:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788863695.339709:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226546048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863695.339716:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788863695.339770:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6712a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226546048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863695.343672:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226546176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863695.343754:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863695.343832:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546176 00000100:00100000:1.0:1788863695.343840:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546176 00000100:00100000:1.0:1788863695.343898:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788863695.343907:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226546176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863695.343940:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863695.343997:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226546176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863695.344003:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788863695.344114:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226546176:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788863696.044445:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863697.067308:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863698.091291:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863698.924161:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226546304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863698.924247:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863698.924342:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863698.924353:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226546432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863698.924376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863698.924829:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546304 00000100:00100000:1.0:1788863698.924844:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546304 00000100:00100000:1.0:1788863698.924929:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546432 00000100:00100000:1.0:1788863698.924933:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546432 00000100:00100000:1.0:1788863698.924959:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788863698.924970:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226546304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863698.925012:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863698.925137:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226546304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863698.925146:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788863698.925175:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788863698.925184:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226546432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863698.925196:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863698.925225:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226546432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863698.925255:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788863698.925399:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863698.925456:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226546432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863698.925474:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226546304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863699.116448:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863699.435605:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226546816:0@lo:400:kworker.0 00000100:00100000:2.0:1788863699.435727:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863699.435977:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226546560:0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436023:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863699.436061:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863699.436068:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226546688:0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436124:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863699.436168:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546560 00000100:00100000:0.0:1788863699.436177:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546560 00000100:00100000:0.0:1788863699.436234:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788863699.436245:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226546560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436305:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226546560:12345-0@lo:400:kworker.0 Request processed in 62us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863699.436313:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788863699.436372:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226546560:0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436396:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226546944:0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436425:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863699.436483:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546688 00000100:00100000:0.0:1788863699.436487:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546688 00000100:00100000:0.0:1788863699.436517:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546944 00000100:00100000:0.0:1788863699.436521:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546944 00000100:00100000:0.0:1788863699.436556:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788863699.436564:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226546688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436603:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226546688:12345-0@lo:400:kworker.0 Request processed in 40us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863699.436609:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788863699.436623:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788863699.436628:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226546944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436697:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226546944:12345-0@lo:400:kworker.0 Request processed in 66us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863699.436703:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788863699.436747:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226546688:0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436769:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226546944:0@lo:400:kworker.0 00000100:00100000:0.0:1788863699.436797:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226546816 00000100:00100000:0.0:1788863699.436801:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226546816 00000100:00100000:0.0:1788863699.436829:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788863699.436835:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226546816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.445620:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226547072:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.445742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.445794:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226547584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.445826:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.445870:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788863699.445877:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226547200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.445905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.445925:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226547712:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.445953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.445999:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547072 00000100:00100000:3.0:1788863699.446011:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547072 00000100:00100000:3.0:1788863699.446104:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788863699.446116:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226547072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.446191:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226547072:12345-0@lo:400:kworker.0 Request processed in 77us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.446199:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788863699.446227:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547584 00000100:00100000:3.0:1788863699.446232:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547584 00000100:00100000:3.0:1788863699.446273:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547200 00000100:00100000:3.0:1788863699.446276:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547200 00000100:00100000:3.0:1788863699.446299:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788863699.446306:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226547584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.446339:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226547584:12345-0@lo:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.446346:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788863699.446384:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788863699.446390:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226547200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.446421:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226547200:12345-0@lo:400:kworker.0 Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.446428:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788863699.446446:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863699.446451:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863699.446513:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226547200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.446528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226547072:0@lo:400:kworker.0 00010000:00080000:3.0:1788863699.446540:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543408000 x1875759226547584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863699.446554:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226547584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.446588:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226547456:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.446622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.446648:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788863699.446667:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226547328:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.446689:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.446706:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226547840:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.447910:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.447985:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547456 00000100:00100000:3.0:1788863699.447994:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547456 00000100:00100000:3.0:1788863699.448063:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547328 00000100:00100000:3.0:1788863699.448066:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547328 00000100:00100000:3.0:1788863699.448110:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788863699.448131:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226547456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.448216:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226547456:12345-0@lo:400:kworker.0 Request processed in 99us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.448224:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788863699.448242:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788863699.448248:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226547328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.448278:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226547328:12345-0@lo:400:kworker.0 Request processed in 31us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.448284:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1788863699.448308:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863699.448312:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788863699.448349:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4b8000 x1875759226547328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863699.448364:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226547328:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.448377:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226547456:0@lo:400:kworker.0 00000100:00100000:1.0:1788863699.448582:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863699.448617:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863699.448645:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863699.448679:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547712 00000100:00100000:1.0:1788863699.448684:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547712 00000100:00100000:1.0:1788863699.448726:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547840 00000100:00100000:1.0:1788863699.448729:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547840 00000100:00100000:1.0:1788863699.448754:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788863699.448762:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226547712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863699.448810:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226547712:12345-0@lo:400:kworker.0 Request processed in 49us (2856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863699.448816:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788863699.448830:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788863699.448835:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226547840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863699.448868:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226547840:12345-0@lo:400:kworker.0 Request processed in 33us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863699.448874:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788863699.448898:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481216 00000100:00100000:1.0:1788863699.448901:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481216 00000100:00100000:1.0:1788863699.448926:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481088 00000100:00100000:1.0:1788863699.448930:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481088 00000100:00100000:1.0:1788863699.448951:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 270 00000100:00100000:1.0:1788863699.448957:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205481216:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863699.449013:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205481216:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 55us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863699.449035:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 270 00000100:00100000:1.0:1788863699.449049:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 271 00000100:00100000:1.0:1788863699.449056:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205481088:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863699.449114:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205481088:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 58us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863699.449120:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 271 00000100:00080000:1.0:1788863699.449277:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863699.449280:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863699.449283:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788863699.449319:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340b100 x1875759226547712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863699.449333:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226547712:0@lo:400:kworker.0 00010000:00080000:1.0:1788863699.449393:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340b480 x1875759226547840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863699.449403:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226547840:0@lo:400:kworker.0 00000100:00100000:3.0:1788863699.451662:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205480960 00000100:00100000:3.0:1788863699.451685:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205480960 00000100:00100000:3.0:1788863699.451761:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 377 00000100:00100000:3.0:1788863699.451772:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205480960:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863699.451882:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205480960:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 112us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.451891:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 377 00000100:00100000:0.0:1788863699.454064:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226546816:12345-0@lo:400:kworker.0 Request processed in 17214us (18323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863699.454096:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788863699.455800:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226546816:0@lo:400:kworker.0 00000100:00100000:1.0:1788863699.457325:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863699.457386:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863699.457648:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481600 00000100:00100000:3.0:1788863699.457674:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481600 00000100:00100000:3.0:1788863699.457777:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 272 00000100:00100000:3.0:1788863699.457790:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205481600:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863699.457914:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205481600:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 126us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.457922:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 272 00000100:00080000:1.0:1788863699.458264:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863699.460610:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481344 00000100:00100000:2.0:1788863699.460632:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481344 00000100:00080000:1.0:1788863699.460910:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863699.461015:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:2.0:1788863699.461055:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2407:x1875759205481344:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:2.0:1788863699.461150:0:8452:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68f37 00000100:00080000:2.0:1788863699.461164:0:8452:0:(import.c:65:import_set_state_nolock()) ffff89e67c4cd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863699.461292:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788863699.461645:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+2:2407:x1875759205481344:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 601us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863699.461669:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00010000:00010000:3.0:1788863699.462387:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863699.463282:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863699.464944:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481472 00000100:00100000:3.0:1788863699.464969:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481472 00000100:00100000:3.0:1788863699.465122:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 273 00000100:00100000:3.0:1788863699.465135:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205481472:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863699.465320:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205481472:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 187us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.465340:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 273 00000100:00080000:1.0:1788863699.465986:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863699.947512:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863699.947559:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226547968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863699.947679:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863699.947840:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226547968 00000100:00100000:3.0:1788863699.947852:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226547968 00000100:00100000:3.0:1788863699.947933:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788863699.947945:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226547968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863699.947986:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863699.948052:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226547968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863699.948060:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1788863699.948550:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54340b480 x1875759226547968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863699.948577:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226547968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863699.949067:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863699.949098:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226548096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863699.949153:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863699.951297:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548096 00000100:00100000:2.0:1788863699.951314:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548096 00000100:00100000:2.0:1788863699.951438:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788863699.951450:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226548096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863699.951482:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863699.951582:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226548096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863699.951590:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:0.0:1788863699.951693:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af58e00 x1875759226548096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863699.951719:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226548096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788863700.142204:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863700.460820:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226548224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863700.460934:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863700.461467:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548224 00000100:00100000:2.0:1788863700.461478:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548224 00000100:00100000:2.0:1788863700.461544:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788863700.461555:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226548224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863700.461602:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863700.461684:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226548224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863700.461693:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788863700.461980:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863700.462011:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226548352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863700.462121:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863700.463183:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226548224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863700.463613:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548352 00000100:00100000:2.0:1788863700.463623:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548352 00000100:00100000:2.0:1788863700.463702:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788863700.463712:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226548352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863700.463766:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788863700.463863:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226548352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863700.463871:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788863700.464013:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226548352:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788863701.163267:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863702.189129:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863703.214795:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863704.047695:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863704.047729:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226548480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863704.047852:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.049332:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548480 00000100:00100000:3.0:1788863704.049349:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548480 00000100:00100000:3.0:1788863704.049440:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863704.049615:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863704.049635:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226548608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863704.049654:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226548480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863704.049695:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863704.049716:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.049771:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226548480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 320us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.049780:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863704.049798:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548608 00000100:00100000:0.0:1788863704.049804:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548608 00000100:00100000:0.0:1788863704.049837:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788863704.049845:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226548608:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863704.049852:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226548480:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863704.049859:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863704.049898:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226548608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863704.049905:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788863704.049916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226548608:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863704.049931:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788863704.176002:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788863704.179935:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788863704.235327:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863704.555391:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226549120:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.555491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.555583:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226549632:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.555607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.555643:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863704.555650:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226548736:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.555699:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.555902:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226549248:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.555957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.555981:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226549760:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.556004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.556226:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226548864:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.556261:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.556297:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226549376:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.556324:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.556344:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226549888:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.556371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.556395:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863704.556401:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226548992:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.556421:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.556440:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226549504:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.556461:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.556471:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226550016:0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.556489:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863704.556527:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226549120 00000100:00100000:3.0:1788863704.556536:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226549120 00000100:00100000:3.0:1788863704.556595:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226549632 00000100:00100000:3.0:1788863704.556598:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226549632 00000100:00100000:3.0:1788863704.556625:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226549760 00000100:00100000:3.0:1788863704.556628:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226549760 00000100:00100000:3.0:1788863704.556640:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548864 00000100:00100000:3.0:1788863704.556642:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548864 00000100:00100000:3.0:1788863704.556652:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226549376 00000100:00100000:3.0:1788863704.556655:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226549376 00000100:00100000:3.0:1788863704.556666:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226549504 00000100:00100000:3.0:1788863704.556668:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226549504 00000100:00100000:3.0:1788863704.556685:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788863704.556694:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226549120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.557144:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226549120:12345-0@lo:400:kworker.0 Request processed in 449us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.557155:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788863704.557206:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788863704.557215:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226549632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.557249:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226549632:12345-0@lo:400:kworker.0 Request processed in 36us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.557255:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788863704.557267:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788863704.557273:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226549760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.557303:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226549760:12345-0@lo:400:kworker.0 Request processed in 31us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.557309:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788863704.557319:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788863704.557325:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226548864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.557356:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226548864:12345-0@lo:400:kworker.0 Request processed in 31us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.557362:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788863704.557373:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788863704.557379:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226549376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.557407:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226549376:12345-0@lo:400:kworker.0 Request processed in 28us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.557412:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788863704.557424:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788863704.557431:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226549504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.557458:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226549504:12345-0@lo:400:kworker.0 Request processed in 28us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.557464:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788863704.557507:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548736 00000100:00100000:3.0:1788863704.557515:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548736 00000100:00100000:3.0:1788863704.557563:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788863704.557571:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226548736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863704.557605:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226548736:12345-0@lo:400:kworker.0 Request processed in 36us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.557612:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788863704.557647:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226549248 00000100:00100000:3.0:1788863704.557651:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226549248 00000100:00100000:3.0:1788863704.557680:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226548992 00000100:00100000:3.0:1788863704.557683:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226548992 00000100:00100000:3.0:1788863704.557697:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788863704.557703:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226549248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.557754:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788863704.557767:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226548992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.557810:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226548992:12345-0@lo:400:kworker.0 Request processed in 48us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863704.557817:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1788863704.557841:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863704.557847:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863704.557859:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226549888 00000100:00100000:1.0:1788863704.557863:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226549888 00000100:00100000:1.0:1788863704.557909:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550016 00000100:00100000:1.0:1788863704.557913:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550016 00000100:00100000:1.0:1788863704.557937:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863704.557943:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226549888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.557977:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226549888:12345-0@lo:400:kworker.0 Request processed in 34us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863704.557984:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863704.557997:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863704.558003:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226550016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.558031:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226550016:12345-0@lo:400:kworker.0 Request processed in 29us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863704.558037:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863704.558143:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863704.558173:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481728 00000100:00100000:1.0:1788863704.558177:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481728 00000100:00100000:1.0:1788863704.558202:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 379 00000100:00100000:1.0:1788863704.558208:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205481728:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863704.558275:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205481728:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863704.558283:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 379 00000100:00100000:3.0:1788863704.558484:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226549248:12345-0@lo:400:kworker.0 Request processed in 780us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.558492:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788863704.558918:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863704.558966:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226548992:0@lo:400:kworker.0 00010000:00080000:1.0:1788863704.558984:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4b8380 x1875759226549504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863704.558997:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226549504:0@lo:400:kworker.0 00010000:00080000:1.0:1788863704.559010:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae5c00 x1875759226550016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863704.559018:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226550016:0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.559032:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226548864:0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.559045:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226549376:0@lo:400:kworker.0 00010000:00080000:1.0:1788863704.559058:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae5180 x1875759226549888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863704.559066:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226549888:0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.559178:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226548736:0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.559191:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226549248:0@lo:400:kworker.0 00010000:00080000:1.0:1788863704.559205:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae4380 x1875759226549760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863704.559214:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226549760:0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.559244:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226549120:0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.559256:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226549632:0@lo:400:kworker.0 00000100:00100000:1.0:1788863704.563288:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863704.563329:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863704.563361:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863704.563363:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481856 00000100:00100000:3.0:1788863704.563379:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481856 00000100:00100000:1.0:1788863704.563392:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205481984 00000100:00100000:1.0:1788863704.563399:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205481984 00000100:00100000:3.0:1788863704.563458:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205482240 00000100:00100000:3.0:1788863704.563462:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205482240 00000100:00100000:2.0:1788863704.563762:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 280 00000100:00100000:2.0:1788863704.563780:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205481856:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863704.563897:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205481856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 122us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863704.563907:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 280 00000100:00100000:1.0:1788863704.567719:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 281 00000100:00100000:1.0:1788863704.567747:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205481984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863704.567755:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 282 00000100:00100000:3.0:1788863704.567769:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205482240:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863704.567946:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205482240:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 179us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.567955:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 282 00000100:00080000:3.0:1788863704.568004:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863704.568012:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863704.568190:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863704.568312:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205482112 00000100:00100000:3.0:1788863704.568323:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205482112 00000100:00100000:3.0:1788863704.568370:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 283 00000100:00100000:3.0:1788863704.568377:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205482112:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863704.568415:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205482112:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863704.568421:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 283 00000100:00080000:3.0:1788863704.568437:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863704.570647:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205481984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 2893us (7296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863704.570672:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 281 00000100:00100000:2.0:1788863705.067728:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863705.067763:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226550144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863705.067856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863705.068126:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550144 00000100:00100000:2.0:1788863705.068136:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550144 00000100:00100000:2.0:1788863705.068320:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788863705.068331:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226550144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863705.068373:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863705.068430:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226550144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863705.068438:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:2.0:1788863705.068722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af58a80 x1875759226550144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863705.068745:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226550144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863705.070302:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226550272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863705.070385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863705.077270:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550272 00000100:00100000:0.0:1788863705.077292:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550272 00000100:00100000:0.0:1788863705.077363:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788863705.077375:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226550272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863705.077412:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863705.077782:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226550272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 408us (7395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863705.077794:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1788863705.081835:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e655c45880 x1875759226550272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863705.081938:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226550272:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788863705.083572:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:1.0:1788863705.083585:0:8444:0:(genops.c:885:class_export_put()) final put ffff89e67c4ce000/7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:3.0:1788863705.083683:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67c4ce000/7a6822fa-e36f-4316-b7e3-4bba6134cbda for lustre-OST0000 00000020:00000080:3.0:1788863705.083756:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67c4cd000 for lustre-OST0000 00010000:00010000:3.0:1788863705.260200:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863705.586257:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863705.586291:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226550400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863705.586397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863705.586418:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863705.586428:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226550528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863705.586460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863705.586491:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550400 00000100:00100000:1.0:1788863705.586500:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550400 00000100:00100000:1.0:1788863705.586570:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550528 00000100:00100000:1.0:1788863705.586573:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550528 00000100:00100000:1.0:1788863705.586668:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788863705.586678:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226550400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863705.586726:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788863705.586780:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226550400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863705.586795:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788863705.586800:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788863705.586808:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226550528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863705.586831:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788863705.586880:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226550528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863705.586886:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788863705.587178:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226550400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863705.587349:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226550528:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788863706.283283:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863707.308892:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863708.331680:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863709.163511:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226550656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863709.163621:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863709.163900:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550656 00000100:00100000:0.0:1788863709.163911:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550656 00000100:00100000:0.0:1788863709.163996:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863709.164010:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226550656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863709.164108:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788863709.164176:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226550656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863709.164184:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863709.164243:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226550656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788863709.164312:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863709.165604:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863709.165630:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226550784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863709.165715:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863709.166046:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550784 00000100:00100000:2.0:1788863709.166057:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550784 00000100:00100000:2.0:1788863709.166157:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788863709.166168:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226550784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863709.166217:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863709.166278:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226550784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863709.166285:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1788863709.166564:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863709.166870:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226550784:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788863709.355389:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863709.677384:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226551040:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.677497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.677577:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226551552:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.677604:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.677632:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226552064:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.677663:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.677697:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788863709.677703:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226550912:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.677738:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.677762:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226551424:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678023:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.678054:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226551936:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.678146:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226551168:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678171:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.678191:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226551680:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678214:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.678232:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226552192:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678256:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.678276:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788863709.678284:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226551296:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.678370:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226551808:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863709.678428:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551040 00000100:00100000:1.0:1788863709.678438:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551040 00000100:00100000:1.0:1788863709.678495:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551552 00000100:00100000:1.0:1788863709.678499:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551552 00000100:00100000:1.0:1788863709.678527:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551936 00000100:00100000:1.0:1788863709.678531:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551936 00000100:00100000:1.0:1788863709.678546:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551680 00000100:00100000:1.0:1788863709.678549:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551680 00000100:00100000:1.0:1788863709.678561:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551296 00000100:00100000:1.0:1788863709.678563:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551296 00000100:00100000:1.0:1788863709.678573:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551808 00000100:00100000:1.0:1788863709.678575:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551808 00000100:00100000:1.0:1788863709.678593:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788863709.678603:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226551040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678669:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226551040:12345-0@lo:400:kworker.0 Request processed in 66us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.678677:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788863709.678698:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788863709.678705:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226551552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.678734:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226551552:12345-0@lo:400:kworker.0 Request processed in 30us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.678740:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788863709.678751:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788863709.678758:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226551936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863709.678928:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551424 00000100:00100000:3.0:1788863709.678934:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551424 00000100:00100000:3.0:1788863709.678970:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226551168 00000100:00100000:3.0:1788863709.678973:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226551168 00000100:00100000:3.0:1788863709.678988:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788863709.678996:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226551424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863709.687504:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226551424:12345-0@lo:400:kworker.0 Request processed in 8492us (9464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863709.687526:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788863709.687581:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788863709.687597:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226551168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863709.687688:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226551168:12345-0@lo:400:kworker.0 Request processed in 98us (9515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863709.687695:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788863709.688558:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863709.688589:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788863709.688606:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226551680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863709.688616:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863709.688629:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863709.688640:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863709.688660:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863709.688661:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226551680:12345-0@lo:400:kworker.0 Request processed in 63us (10447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863709.688669:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788863709.688679:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226550912 00000100:00100000:3.0:1788863709.688690:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226550912 00000100:00100000:2.0:1788863709.688690:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205482624 00000100:00100000:2.0:1788863709.688692:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205482624 00000100:00100000:2.0:1788863709.688727:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205482880 00000100:00100000:2.0:1788863709.688729:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205482880 00000100:00100000:3.0:1788863709.688733:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205482368 00000100:00100000:3.0:1788863709.688736:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205482368 00000100:00100000:2.0:1788863709.688742:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205482496 00000100:00100000:2.0:1788863709.688744:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205482496 00000100:00100000:3.0:1788863709.688747:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788863709.688758:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205482752 00000100:00100000:2.0:1788863709.688760:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205482752 00000100:00100000:2.0:1788863709.688774:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788863709.688793:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226551296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863709.688831:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226551296:12345-0@lo:400:kworker.0 Request processed in 50us (10484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863709.688837:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788863709.688851:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788863709.688858:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226551808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863709.689012:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226550912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863709.689055:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226550912:12345-0@lo:400:kworker.0 Request processed in 302us (11316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863709.689062:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788863709.689115:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 381 00000100:00100000:3.0:1788863709.689122:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205482368:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863709.689173:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205482368:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863709.689180:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 381 00000100:00100000:1.0:1788863709.689541:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226551936:12345-0@lo:400:kworker.0 Request processed in 10779us (11421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.689558:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788863709.689616:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226551296:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.689632:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226551168:0@lo:400:kworker.0 00010000:00080000:1.0:1788863709.689647:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4b8000 x1875759226551680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863709.689658:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226551680:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.689700:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 290 00000100:00100000:1.0:1788863709.689708:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205482624:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863709.689756:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205482624:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 50us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.689763:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 290 00000100:00100000:1.0:1788863709.689777:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 291 00000100:00100000:1.0:1788863709.689784:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205482880:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863709.689806:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205482880:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.689811:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 291 00000100:00100000:1.0:1788863709.689821:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 292 00000100:00100000:1.0:1788863709.689827:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205482496:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863709.690023:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205482496:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 195us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.690030:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 292 00000100:00100000:1.0:1788863709.690043:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 293 00000100:00100000:1.0:1788863709.690056:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205482752:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863709.690109:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205482752:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.690115:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 293 00000100:00100000:1.0:1788863709.690138:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552064 00000100:00100000:1.0:1788863709.690143:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552064 00000100:00100000:1.0:1788863709.690190:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552192 00000100:00100000:1.0:1788863709.690193:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552192 00000100:00100000:1.0:1788863709.690212:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788863709.690218:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226552064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.690259:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226552064:12345-0@lo:400:kworker.0 Request processed in 42us (12595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.690264:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788863709.690274:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788863709.690279:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226552192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.690306:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226552192:12345-0@lo:400:kworker.0 Request processed in 27us (12050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863709.690311:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788863709.690348:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863709.690353:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863709.690356:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788863709.690379:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681d01f80 x1875759226552192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863709.690390:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226552192:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.690414:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226550912:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.690427:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226551424:0@lo:400:kworker.0 00010000:00080000:1.0:1788863709.690450:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4b8380 x1875759226551936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863709.690473:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226551936:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.690487:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226551040:0@lo:400:kworker.0 00000100:00100000:1.0:1788863709.690498:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226551552:0@lo:400:kworker.0 00010000:00080000:1.0:1788863709.690509:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438c1880 x1875759226552064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863709.690517:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226552064:0@lo:400:kworker.0 00000100:00100000:2.0:1788863709.691150:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226551808:12345-0@lo:400:kworker.0 Request processed in 2286us (12750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863709.691160:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788863709.691379:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226551808:0@lo:400:kworker.0 00000100:00100000:2.0:1788863710.187295:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863710.187319:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226552320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863710.187393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863710.187483:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552320 00000100:00100000:2.0:1788863710.187491:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552320 00000100:00100000:2.0:1788863710.187540:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788863710.187550:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226552320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863710.187582:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863710.187629:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226552320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863710.187636:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1788863710.187678:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af5a300 x1875759226552320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863710.187695:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226552320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863710.192248:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226552448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863710.192338:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863710.192389:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552448 00000100:00100000:2.0:1788863710.192398:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552448 00000100:00100000:2.0:1788863710.192457:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788863710.192468:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226552448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863710.192493:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863710.192634:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226552448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863710.192643:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:0.0:1788863710.197282:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e655c45180 x1875759226552448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863710.197312:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226552448:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863710.391822:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788863710.472546:0:14081:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:35:08 (1788863708) 00000100:00100000:2.0:1788863710.701782:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863710.701819:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226552576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863710.701931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863710.702117:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552576 00000100:00100000:1.0:1788863710.702129:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552576 00000100:00100000:1.0:1788863710.702195:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788863710.702207:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226552576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863710.702256:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863710.702321:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226552576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863710.702329:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788863710.702388:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226552576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863710.705987:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226552704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863710.706123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863710.706277:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552704 00000100:00100000:0.0:1788863710.706288:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552704 00000100:00100000:0.0:1788863710.706354:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788863710.706366:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226552704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863710.706412:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788863710.706496:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226552704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863710.706503:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788863710.706574:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226552704:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788863711.404933:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863712.427321:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863712.531741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863712.533580:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205483008 00000100:00100000:1.0:1788863712.533595:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205483008 00000100:00100000:1.0:1788863712.533782:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:1.0:1788863712.533795:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:11091:x1875759205483008:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863712.533832:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863712.533875:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e95 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.533948:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6901e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.533963:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6901e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.533976:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6901e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863712.534036:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788863712.534040:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863712.534263:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6901e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.534306:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e95 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.534325:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6901e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e95 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.534333:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:1.0:1788863712.534336:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863712.534339:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fe00, rc 0) 00000100:00100000:1.0:1788863712.535372:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:11091:x1875759205483008:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 1575us (4017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863712.535382:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00080000:3.0:1788863712.535511:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863712.572281:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863712.572465:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205483136 00000100:00100000:1.0:1788863712.572476:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205483136 00000100:00100000:1.0:1788863712.572540:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:1.0:1788863712.572551:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:11092:x1875759205483136:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863712.572572:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863712.572594:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187e9c expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572783:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572798:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572808:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572829:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572836:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572842:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572909:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b6903a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572918:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b6903a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.572944:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b6903a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863712.572983:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788863712.572987:0:10368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863712.573006:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b6903a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573017:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573023:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573030:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573036:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863712.573040:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573048:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573060:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:1.0:1788863712.573063:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863712.573068:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573115:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6902c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573143:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573149:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573154:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573159:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863712.573162:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573168:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573175:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89e643aa2700) 00010000:00010000:1.0:1788863712.573178:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863712.573181:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573186:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69033 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573216:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e9c expref: 8 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573229:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b6903a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e9c expref: 7 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863712.573250:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e643aa2500) 00010000:00010000:1.0:1788863712.573252:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863712.573255:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f600, rc 0) 00000100:00100000:0.0:1788863712.574901:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:11092:x1875759205483136:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 2340us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863712.574912:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:0.0:1788863712.583612:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863712.584113:0:6548:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205483264 00000100:00100000:2.0:1788863712.584124:0:6548:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205483264 00000100:00100000:2.0:1788863712.584242:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:2.0:1788863712.584253:0:6548:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:11092:x1875759205483264:12345-192.168.204.35@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788863712.584359:0:6548:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:11092:x1875759205483264:12345-192.168.204.35@tcp:900:lhsmtool_posix.0 Request processed in 107us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863712.584367:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788863712.593742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863712.594596:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205483520 00000100:00100000:2.0:1788863712.594609:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205483520 00000100:00100000:2.0:1788863712.594678:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:2.0:1788863712.594688:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:11092:x1875759205483520:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863712.594708:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863712.594729:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b69041 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ea3 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595018:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595033:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595045:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595127:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595135:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595158:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595273:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b69056 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.595283:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b69056 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.596149:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b69056 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863712.596162:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788863712.596263:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.596272:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.596279:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.596891:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863712.596898:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.596907:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.596987:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e643aa2500) 00010000:00010000:2.0:1788863712.596990:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863712.597010:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597018:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69048 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597033:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597040:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597046:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597051:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863712.597054:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597060:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597068:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89e543755d00) 00010000:00010000:2.0:1788863712.597071:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863712.597188:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597196:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6904f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597522:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b69041 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ea3 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597551:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b69056 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ea3 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863712.597559:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:2.0:1788863712.597562:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863712.597564:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98c00, rc 0) 00000100:00100000:2.0:1788863712.597688:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:11092:x1875759205483520:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 3000us (3954us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788863712.597697:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:0.0:1788863712.609053:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863712.610361:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205483648 00000100:00100000:1.0:1788863712.610382:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205483648 00000100:00100000:1.0:1788863712.610467:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:1.0:1788863712.610478:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:11092:x1875759205483648:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788863712.610602:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:11092:x1875759205483648:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 125us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863712.610609:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:0.0:1788863712.620003:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863712.621215:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205483776 00000100:00100000:1.0:1788863712.621229:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205483776 00000100:00100000:1.0:1788863712.621339:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:1.0:1788863712.621352:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:11092:x1875759205483776:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788863712.622168:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788863712.623144:0:10368:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1736us 00000100:00100000:3.0:1788863712.658123:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:11092:x1875759205483776:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 36761us (38126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863712.658138:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00000040:00080000:3.0:1788863713.387749:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788863713.391964:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863713.451259:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863714.284252:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863714.284276:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226552832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863714.284347:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863714.284441:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552832 00000100:00100000:0.0:1788863714.284450:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552832 00000100:00100000:0.0:1788863714.284513:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788863714.284528:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226552832:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788863714.284553:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788863714.284561:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863714.284578:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226552960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863714.284626:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226552832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.284637:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788863714.284655:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863714.284698:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226552832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863714.284767:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226552960 00000100:00100000:3.0:1788863714.284785:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226552960 00000100:00100000:3.0:1788863714.284855:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788863714.284864:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226552960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863714.285560:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863714.285641:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226552960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 776us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863714.285650:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788863714.285905:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226552960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863714.285985:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788863714.412813:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788863714.413182:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863714.480117:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863714.796618:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226553472:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.796690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.796753:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226553984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.796775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.796807:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788863714.796812:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226553088:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.796840:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.796870:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226553600:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.796894:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.796912:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226554112:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.796931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.796954:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226553344:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.796977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.796991:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226553856:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.797026:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226554368:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.797066:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788863714.797071:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226553216:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797111:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.797129:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226553728:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797150:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863714.797161:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226554240:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863714.797181:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553600 00000100:00100000:0.0:1788863714.797189:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553600 00000100:00100000:1.0:1788863714.797203:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553472 00000100:00100000:1.0:1788863714.797206:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553472 00000100:00100000:1.0:1788863714.797227:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553984 00000100:00100000:0.0:1788863714.797227:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553344 00000100:00100000:1.0:1788863714.797229:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553984 00000100:00100000:0.0:1788863714.797229:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553344 00000100:00100000:1.0:1788863714.797248:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226554112 00000100:00100000:1.0:1788863714.797250:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226554112 00000100:00100000:0.0:1788863714.797252:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788863714.797259:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226553600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797264:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553856 00000100:00100000:1.0:1788863714.797266:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553856 00000100:00100000:1.0:1788863714.797276:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553216 00000100:00100000:1.0:1788863714.797278:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553216 00000100:00100000:1.0:1788863714.797295:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553728 00000100:00100000:1.0:1788863714.797297:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553728 00000100:00100000:1.0:1788863714.797310:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788863714.797315:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226553472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797318:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226553600:12345-0@lo:400:kworker.0 Request processed in 60us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.797324:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788863714.797341:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788863714.797347:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226553344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797372:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226553472:12345-0@lo:400:kworker.0 Request processed in 56us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.797378:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788863714.797387:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226553344:12345-0@lo:400:kworker.0 Request processed in 40us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.797392:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788863714.797393:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788863714.797399:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226553984:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788863714.797406:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863714.797410:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863714.797432:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226553984:12345-0@lo:400:kworker.0 Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.797436:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226553344:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797437:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788863714.797448:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788863714.797454:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226554112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797460:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226553600:0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797469:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226553472:0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797478:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226553984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797479:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226554112:12345-0@lo:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.797484:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788863714.797495:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00010000:00080000:0.0:1788863714.797495:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543610380 x1875759226554112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863714.797500:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226553856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797505:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226554112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797540:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226554368 00000100:00100000:1.0:1788863714.797544:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226553856:12345-0@lo:400:kworker.0 Request processed in 43us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.797550:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788863714.797560:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226554368 00000100:00100000:1.0:1788863714.797562:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788863714.797567:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226553216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797588:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226554240 00000100:00100000:0.0:1788863714.797591:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226554240 00000100:00100000:1.0:1788863714.797592:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226553216:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.797603:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788863714.797608:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788863714.797613:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226554368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797614:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788863714.797619:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226553728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863714.797645:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226553728:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.797645:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226554368:12345-0@lo:400:kworker.0 Request processed in 31us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.797650:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788863714.797651:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788863714.797662:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788863714.797667:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226554240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797691:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226554240:12345-0@lo:400:kworker.0 Request processed in 24us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.797696:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788863714.797718:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226553088 00000100:00100000:0.0:1788863714.797721:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226553088 00000100:00100000:0.0:1788863714.797757:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788863714.797764:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226553088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797798:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226553088:12345-0@lo:400:kworker.0 Request processed in 35us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.797803:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:0.0:1788863714.797832:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863714.797848:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226553216:0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797856:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226553728:0@lo:400:kworker.0 00010000:00080000:0.0:1788863714.797865:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543612d80 x1875759226554240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863714.797873:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226554240:0@lo:400:kworker.0 00010000:00080000:0.0:1788863714.797882:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543613800 x1875759226553856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863714.797890:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226553856:0@lo:400:kworker.0 00010000:00080000:0.0:1788863714.797909:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543613480 x1875759226554368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863714.797916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226554368:0@lo:400:kworker.0 00000100:00100000:0.0:1788863714.797942:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226553088:0@lo:400:kworker.0 00000100:00100000:2.0:1788863714.799732:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863714.799778:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863714.800255:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205484160 00000100:00100000:2.0:1788863714.800265:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205484160 00000100:00100000:2.0:1788863714.800329:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:2.0:1788863714.800339:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:11135:x1875759205484160:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863714.800370:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863714.800391:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187eaa expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800452:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800468:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800499:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800517:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800525:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800531:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800576:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800584:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800591:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800597:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863714.800600:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800607:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800620:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:2.0:1788863714.800623:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863714.800627:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800641:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6906b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800654:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800659:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800665:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800669:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863714.800672:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800677:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800685:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89e542bf3600) 00010000:00010000:2.0:1788863714.800687:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863714.800689:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800695:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69072 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800727:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69064 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eaa expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800750:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:2.0:1788863714.800752:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863714.800756:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eaa expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863714.800766:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98200, rc 0) 00000100:00100000:1.0:1788863714.801201:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205483904 00000100:00100000:1.0:1788863714.801209:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205483904 00000100:00100000:1.0:1788863714.801362:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 383 00000100:00100000:2.0:1788863714.801364:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:11135:x1875759205484160:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1012us (1570us total) trans 0 rc 301/301 00000100:00100000:1.0:1788863714.801375:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205483904:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863714.801377:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:1.0:1788863714.801421:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205483904:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 49us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.801429:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 383 00000100:00080000:2.0:1788863714.801543:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863714.806260:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863714.806339:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205484032 00000100:00100000:0.0:1788863714.806360:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205484032 00000100:00100000:0.0:1788863714.806427:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 300 00000100:00100000:0.0:1788863714.806438:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205484032:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863714.806527:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205484032:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863714.806535:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 300 00000100:00100000:2.0:1788863714.820181:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863714.820327:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863714.820487:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863714.831602:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863714.837619:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205484288 00000100:00100000:1.0:1788863714.837641:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205484288 00000100:00100000:1.0:1788863714.837791:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205484672 00000100:00100000:1.0:1788863714.837796:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205484672 00000100:00100000:1.0:1788863714.837900:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205484416 00000100:00100000:1.0:1788863714.837904:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205484416 00000100:00100000:1.0:1788863714.837930:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 301 00000100:00100000:1.0:1788863714.837941:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205484288:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863714.838035:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205484288:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 95us (17868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.838043:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 301 00000100:00100000:1.0:1788863714.838063:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 302 00000100:00100000:1.0:1788863714.838069:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205484416:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863714.838200:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205484416:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 131us (17713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.838206:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 302 00000100:00100000:1.0:1788863714.838221:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:1.0:1788863714.838462:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:11135:x1875759205484672:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:1.0:1788863714.838510:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863714.838542:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6901e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e95 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.838561:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:1.0:1788863714.838571:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863714.838629:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.838642:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.838653:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.838665:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.838672:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.838679:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841069:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841113:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841127:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863714.841147:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098641ed5 reply state 0000000055a12d3f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841158:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841167:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863714.841171:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863714.841176:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788863714.841185:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788863714.841194:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841201:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841208:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841215:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863714.841219:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841442:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841455:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:1.0:1788863714.841457:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863714.841461:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841468:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69079 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863714.841489:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098641ed5 reply state 0000000055a12d3f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841498:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.841505:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89e643aa2a00) 00010000:00010000:1.0:1788863714.841507:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863714.841510:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788863714.841628:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:11135:x1875759205484672:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 3395us (21295us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788863714.841638:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00080000:0.0:1788863714.842349:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863714.842365:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863714.844592:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205484800 00000100:00100000:1.0:1788863714.844604:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205484800 00000100:00080000:0.0:1788863714.844658:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863714.844689:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 303 00000100:00100000:1.0:1788863714.844701:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205484800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863714.844795:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205484800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 96us (13204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.845207:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 303 00000100:00100000:0.0:1788863714.951522:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863714.953423:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205484928 00000100:00100000:1.0:1788863714.953438:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205484928 00000100:00100000:1.0:1788863714.953520:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:1.0:1788863714.953531:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:11143:x1875759205484928:12345-192.168.204.35@tcp:101:lctl.0 00010000:00010000:1.0:1788863714.953563:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863714.953590:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6908e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187eb1 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.953682:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.953696:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.953709:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863714.953757:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788863714.953761:0:10368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863714.953801:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.953845:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6908e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eb1 expref: 12 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.953864:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eb1 expref: 11 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863714.953885:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:1.0:1788863714.953888:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863714.953892:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fe00, rc 0) 00000100:00100000:1.0:1788863714.953959:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:11143:x1875759205484928:12345-192.168.204.35@tcp:101:lctl.0 Request processed in 430us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863714.953967:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:2.0:1788863715.029141:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.029481:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205485056 00000100:00100000:3.0:1788863715.029493:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205485056 00000100:00100000:3.0:1788863715.029553:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:3.0:1788863715.029562:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:11149:x1875759205485056:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863715.029585:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863715.029609:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6909c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187eb8 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.029674:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.029690:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.029703:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.029714:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.029721:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.029748:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030817:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b690b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030837:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b690b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030847:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b690b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863715.030887:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788863715.030892:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863715.030935:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b690b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030949:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030955:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030961:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030966:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863715.030970:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.030977:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031012:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:3.0:1788863715.031015:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863715.031021:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031028:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b690a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031040:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031047:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031053:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031058:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863715.031062:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031068:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031091:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89e643aa2a00) 00010000:00010000:3.0:1788863715.031094:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863715.031097:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031103:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b690aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031154:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6909c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eb8 expref: 13 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031169:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b690b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eb8 expref: 12 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.031182:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863715.031185:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788863715.031188:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030000, rc 0) 00000100:00100000:3.0:1788863715.031262:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:11149:x1875759205485056:12345-192.168.204.35@tcp:101:bash.0 Request processed in 1699us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.031271:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:0.0:1788863715.035160:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.035286:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205485312 00000100:00100000:1.0:1788863715.035297:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205485312 00000100:00100000:1.0:1788863715.035634:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:1.0:1788863715.035646:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:11149:x1875759205485312:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863715.035668:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863715.035692:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b690b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ebf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.035805:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.035822:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.035834:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.035878:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.035886:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.035909:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863715.036283:0:6537:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788863715.036444:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036455:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036463:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036494:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036501:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036508:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036515:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863715.036520:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036527:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036541:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863715.036545:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863715.036556:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036563:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b690bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863715.036576:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006981e017 reply state 00000000ba378640 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036587:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036593:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:1.0:1788863715.036595:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863715.036598:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788863715.036629:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b690b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036643:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 14 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.036650:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:1.0:1788863715.036652:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863715.036654:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e200, rc 0) 00000100:00100000:1.0:1788863715.036721:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11149:x1875759205485312:12345-192.168.204.35@tcp:101:bash.0 Request processed in 1078us (1572us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788863715.036730:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:2.0:1788863715.041503:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.042435:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205485440 00000100:00100000:3.0:1788863715.042450:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205485440 00000100:00100000:3.0:1788863715.042500:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:3.0:1788863715.042508:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2407:x1875759205485440:12345-192.168.204.35@tcp:8:bash.0 00010000:00080000:3.0:1788863715.042541:0:8606:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:3.0:1788863715.042572:0:8606:0:(genops.c:1384:class_connect()) connect: client 7a6822fa-e36f-4316-b7e3-4bba6134cbda, cookie 0xf569beb9d4b690db 00002000:00100000:3.0:1788863715.042583:0:8606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a6822fa-e36f-4316-b7e3-4bba6134cbda/ffff89e675662800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788863715.042600:0:8606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1788863715.042679:0:8606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788863715.042709:0:8606:0:(import.c:65:import_set_state_nolock()) ffff89e675667000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863715.042780:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2407:x1875759205485440:12345-192.168.204.35@tcp:8:bash.0 Request processed in 272us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.042788:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:1.0:1788863715.045612:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863715.045725:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205485568 00000100:00100000:0.0:1788863715.045735:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205485568 00000100:00100000:2.0:1788863715.045920:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:2.0:1788863715.045932:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:0:x1875759205485568:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788863715.045952:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863715.045975:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ec6 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863715.046002:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863715.046021:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1788863715.046038:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863715.046048:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.046095:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.046112:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:2.0:1788863715.046183:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:0:x1875759205485568:12345-192.168.204.35@tcp:101:bash.0 Request processed in 253us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.046190:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00080000:0.0:1788863715.048720:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863715.061964:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863715.063173:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205485696 00000100:00100000:0.0:1788863715.063186:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205485696 00000100:00100000:2.0:1788863715.066149:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:2.0:1788863715.066163:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:11149:x1875759205485696:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788863715.066182:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863715.066204:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ecd expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.066253:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.066262:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863715.066268:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863715.066272:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.066329:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.066343:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 8 pid: 8452 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863715.066369:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1875759226554496:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863715.066493:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863715.075059:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1875759226554496:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863715.075145:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.075168:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99400, rc 0) 00000100:00100000:2.0:1788863715.075390:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:11149:x1875759205485696:12345-192.168.204.35@tcp:101:bash.0 Request processed in 9228us (13434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.075400:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:1.0:1788863715.078739:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.079641:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205485824 00000100:00100000:3.0:1788863715.079931:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205485824 00010000:00010000:3.0:1788863715.079999:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 8 pid: 8452 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863715.080052:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:3.0:1788863715.080063:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205485824:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863715.080100:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863715.080123:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 8 pid: 8452 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.080138:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 8 pid: 8452 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.080163:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b690e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ec6 expref: 8 pid: 8452 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.080181:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863715.080185:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863715.080194:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.080204:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.080386:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863715.080419:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6524:1875759226554624:192.168.204.35@tcp:105: 00000100:00100000:3.0:1788863715.080507:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863715.088465:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6524:1875759226554624:192.168.204.35@tcp:105: 00010000:00010000:3.0:1788863715.088496:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863715.088579:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205485824:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 8518us (9851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.088592:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788863715.090826:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.090927:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205486080 00000100:00100000:3.0:1788863715.090937:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205486080 00000100:00100000:3.0:1788863715.091051:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1788863715.091062:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11149:x1875759205486080:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:2.0:1788863715.091886:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11149:x1875759205486080:12345-192.168.204.35@tcp:35:bash.0 Request processed in 821us (1062us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788863715.091901:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:1.0:1788863715.213626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863715.213759:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205486336 00000100:00100000:2.0:1788863715.213770:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205486336 00000100:00100000:2.0:1788863715.213832:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:2.0:1788863715.213842:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11159:x1875759205486336:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863715.213874:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863715.213896:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b690f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ed4 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863715.213997:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788863715.214267:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b690f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ed4 expref: 18 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.214282:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:2.0:1788863715.214286:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863715.214291:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b690f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ed4 expref: 18 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.214306:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:2.0:1788863715.214433:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:11159:x1875759205486336:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 592us (816us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788863715.214440:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:0.0:1788863715.224972:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.225137:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205486592 00000100:00100000:1.0:1788863715.225150:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205486592 00000100:00100000:1.0:1788863715.225231:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788863715.225241:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:11159:x1875759205486592:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863715.226256:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:11159:x1875759205486592:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 1011us (1289us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788863715.226267:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:3.0:1788863715.307681:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863715.313225:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226554880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863715.313313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863715.313714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226554752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863715.313747:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863715.313800:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226554880 00000100:00100000:3.0:1788863715.313809:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226554880 00000100:00100000:3.0:1788863715.313851:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226554752 00000100:00100000:3.0:1788863715.313854:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226554752 00000100:00100000:3.0:1788863715.313870:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788863715.313878:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226554880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863715.313902:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863715.313948:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226554880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.313970:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788863715.313986:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788863715.313993:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226554752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863715.314003:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863715.314029:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226554752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.314035:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788863715.314104:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226554880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863715.314121:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226554752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863715.343592:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.357685:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205486720 00000100:00100000:3.0:1788863715.357711:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205486720 00000100:00100000:3.0:1788863715.357842:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:3.0:1788863715.357856:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:11165:x1875759205486720:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863715.357889:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863715.357917:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b690fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187edb expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.358005:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.358024:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.358037:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863715.358122:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788863715.358147:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863715.358180:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.358214:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b690fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187edb expref: 20 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.358250:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187edb expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.358261:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863715.358265:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863715.358270:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030800, rc 0) 00000100:00100000:3.0:1788863715.358367:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11165:x1875759205486720:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 514us (14789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.358376:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:3.0:1788863715.362053:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.362256:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205486976 00000100:00100000:1.0:1788863715.362270:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205486976 00000100:00100000:1.0:1788863715.362359:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:1.0:1788863715.362370:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11165:x1875759205486976:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863715.362398:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863715.362427:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6910c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ee2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.362579:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69113 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.362598:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.362612:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863715.362625:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788863715.362771:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6910c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ee2 expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.362810:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69113 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ee2 expref: 21 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.362839:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:1.0:1788863715.362843:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863715.362847:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863715.362924:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11165:x1875759205486976:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 557us (887us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788863715.362932:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788863715.369064:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863715.370134:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205487104 00000100:00100000:2.0:1788863715.370153:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205487104 00000100:00100000:2.0:1788863715.370260:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:2.0:1788863715.370272:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:2410:x1875759205487104:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863715.370288:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863715.370314:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69113 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ee2 expref: 21 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.370338:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:2.0:1788863715.370355:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863715.370437:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:2410:x1875759205487104:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 167us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.370445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:0.0:1788863715.371512:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.372672:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205487360 00000100:00100000:3.0:1788863715.372694:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205487360 00000100:00100000:3.0:1788863715.372796:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:3.0:1788863715.372809:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11165:x1875759205487360:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863715.372845:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863715.372875:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69121 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ee9 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.373028:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69128 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.373047:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.373127:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863715.373146:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788863715.373304:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69121 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ee9 expref: 23 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.373326:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69128 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ee9 expref: 22 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.373335:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:3.0:1788863715.373338:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788863715.373359:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031400, rc 0) 00000100:00100000:3.0:1788863715.373445:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11165:x1875759205487360:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 638us (1936us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788863715.373454:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:1.0:1788863715.392054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863715.392354:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205487488 00000100:00100000:0.0:1788863715.392388:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205487488 00000100:00100000:0.0:1788863715.392532:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:0.0:1788863715.392545:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205487488:12345-192.168.204.35@tcp:1:lfs.0 00010000:00010000:0.0:1788863715.392611:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.392650:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.392661:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863715.392666:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863715.392672:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.392725:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.392744:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 7 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863715.392762:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543610e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1875759226555008:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863715.398232:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863715.399474:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543610e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1875759226555008:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863715.399514:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863715.415025:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863715.424476:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205487616 00000100:00100000:0.0:1788863715.424493:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205487616 00002000:00100000:0.0:1788863715.424553:0:8456:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff89e542ae4380 x1875759205487616/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:701/0 lens 504/0 e 0 to 0 dl 1788863726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863715.424564:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e542ae4380 with x1875759205487616 ext(0->12) 00010000:00010000:0.0:1788863715.424590:0:8456:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 8 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.425415:0:8456:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 8 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863715.425427:0:8456:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89e542ae4380 00000100:00100000:0.0:1788863715.425462:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1788863715.425475:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205487616:12345-192.168.204.35@tcp:4:lfs.0 00000001:00100000:2.0:1788863715.441290:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000100:00100000:0.0:1788863715.443889:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205487616:12345-192.168.204.35@tcp:4:lfs.0 Request processed in 18401us (28858us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788863715.443909:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00002000:00100000:0.0:1788863715.443927:0:8456:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff89e542ae4380 x1875759205487616/t4294967300(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:701/0 lens 504/448 e 0 to 0 dl 1788863726 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863715.443939:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e542ae4380 with x1875759205487616 ext(0->12) 00010000:00010000:0.0:1788863715.443953:0:8456:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 9 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.443978:0:8456:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 9 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863715.443987:0:8456:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89e542ae4380 00000100:00100000:0.0:1788863715.450420:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.450720:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205487744 00000100:00100000:3.0:1788863715.450734:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205487744 00010000:00010000:3.0:1788863715.450787:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 9 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863715.450839:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:3.0:1788863715.450851:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2411:x1875759205487744:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863715.450873:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788863715.450898:0:6523:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788863715.450902:0:6523:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788863715 00002000:00010000:3.0:1788863715.450925:0:6523:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788863715 00002000:00010000:3.0:1788863715.450927:0:6523:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788863715 00002000:00010000:3.0:1788863715.450930:0:6523:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788863715.450940:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 9 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.450958:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 9 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.450990:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b690e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ecd expref: 9 pid: 8451 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.451025:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863715.451030:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863715.451037:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.451049:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.451156:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863715.451406:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205487744:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 554us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.451416:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00010000:00010000:0.0:1788863715.452886:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.452934:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.452971:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.452981:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.452990:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.452997:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91a00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863715.453002:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.453024:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.453048:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863715.453067:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000127ce595/0xf569beb9d4b69136 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863715.453604:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205487488:12345-192.168.204.35@tcp:1:lfs.0 Request processed in 61054us (61558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863715.453618:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:1.0:1788863715.465861:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863715.465985:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205488000 00000100:00100000:3.0:1788863715.465995:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205488000 00000100:00100000:3.0:1788863715.466209:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:3.0:1788863715.466220:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11165:x1875759205488000:12345-192.168.204.35@tcp:35:lfs.0 00000004:00010000:3.0:1788863715.466307:0:6539:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69128 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ee9 expref: 22 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863715.466539:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788863715.466585:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788863715.466896:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788863715.466933:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.466950:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 26 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.466960:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.467000:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 26 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.467017:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 26 pid: 6537 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863715.467045:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439fe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875759226555136:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863715.467197:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863715.475794:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.476352:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439fe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875759226555136:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863715.476381:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863715.477451:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205488128 00000100:00100000:2.0:1788863715.477463:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205488128 00010000:00010000:2.0:1788863715.477510:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 27 pid: 6537 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863715.477563:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:2.0:1788863715.477573:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:2409:x1875759205488128:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863715.477588:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863715.477595:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 27 pid: 6537 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.477618:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 27 pid: 6537 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.477642:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b690cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ebf expref: 27 pid: 6537 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.477662:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:2.0:1788863715.477668:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.477697:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.477704:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.477750:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863715.477821:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:2409:x1875759205488128:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 248us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.477829:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00010000:00010000:1.0:1788863715.477857:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.477867:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863715.478001:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788863715.478166:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788863715.478286:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226555264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788863715.478356:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863715.478447:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64133a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863715.481265:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226555264 00000100:00100000:2.0:1788863715.481282:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226555264 00000100:00100000:2.0:1788863715.481430:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788863715.481442:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6539:x1875759226555264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788863715.482931:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6539:x1875759226555264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1486us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.482944:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788863715.485487:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226555264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788863715.485785:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788863715.485891:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226555392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788863715.485949:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863715.485991:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e661f319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863715.486263:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226555392 00000100:00100000:2.0:1788863715.486271:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226555392 00000100:00100000:2.0:1788863715.486349:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788863715.486359:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6539:x1875759226555392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788863715.486514:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6539:x1875759226555392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (564us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788863715.486522:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788863715.486768:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226555392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788863715.487141:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788863715.487186:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.487196:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.487204:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.487209:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167c200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863715.487214:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.487220:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.487237:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:1.0:1788863715.487239:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788863715.487244:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.487249:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b6913d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863715.487361:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788863715.487420:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788863715.487445:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382611368374ns, next at 383611366328ns, rc = 0 00000001:00080000:1.0:1788863715.487453:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788863715.487478:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:1.0:1788863715.487481:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863715.487489:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69128 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ee9 expref: 30 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863715.487806:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:11165:x1875759205488000:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 21587us (21955us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788863715.487826:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000020:00080000:1.0:1788863715.487834:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788863715.497915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.498395:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205488256 00000100:00100000:1.0:1788863715.498410:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205488256 00000100:00100000:1.0:1788863715.498508:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:1.0:1788863715.498522:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:11165:x1875759205488256:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863715.498560:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863715.498594:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b69144 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ef0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.499223:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863715.500193:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b69144 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ef0 expref: 30 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.500220:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b69144 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ef0 expref: 30 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.500618:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863715.500623:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863715.500629:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f000, rc 0) 00000100:00100000:1.0:1788863715.505545:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:11165:x1875759205488256:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 7008us (7627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863715.505563:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:3.0:1788863715.510639:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863715.518399:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205488512 00000100:00100000:2.0:1788863715.518426:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205488512 00000100:00100000:2.0:1788863715.518906:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:2.0:1788863715.518942:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bdb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:11165:x1875759205488512:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788863715.519371:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bdb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+31:11165:x1875759205488512:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 432us (8749us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788863715.519380:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:3.0:1788863715.634897:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.635206:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205488768 00000100:00100000:1.0:1788863715.635221:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205488768 00000100:00100000:1.0:1788863715.635371:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:1.0:1788863715.635386:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+31:11175:x1875759205488768:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863715.635427:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863715.635457:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6914b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ef7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863715.635687:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788863715.635834:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6914b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ef7 expref: 33 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.636546:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:1.0:1788863715.636554:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863715.636565:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6914b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ef7 expref: 33 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.636586:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e400, rc 0) 00000100:00100000:1.0:1788863715.636733:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:11175:x1875759205488768:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1349us (1852us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788863715.636743:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:3.0:1788863715.649831:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863715.649964:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205488896 00000100:00100000:2.0:1788863715.649978:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205488896 00000100:00100000:2.0:1788863715.650052:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:2.0:1788863715.650063:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:11175:x1875759205488896:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:2.0:1788863715.650198:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650236:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650251:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650274:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650282:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650289:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650404:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650413:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650428:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863715.650505:0:12972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650521:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650529:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650537:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650544:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863715.650548:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650556:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650569:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788863715.650572:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863715.650578:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650585:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69159 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650599:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650612:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650618:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650623:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863715.650626:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650632:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650640:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:2.0:1788863715.650643:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863715.650646:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650653:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69160 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650677:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650683:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650690:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650695:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863715.650705:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650710:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650718:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863715.650720:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863715.650723:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.650728:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863715.651824:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:11175:x1875759205488896:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 1748us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.651839:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:3.0:1788863715.658824:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.659615:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205489152 00000100:00100000:1.0:1788863715.659633:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205489152 00000100:00100000:1.0:1788863715.659720:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1788863715.659733:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:11175:x1875759205489152:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863715.660413:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:11175:x1875759205489152:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 679us (1597us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788863715.660425:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:0.0:1788863715.737676:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.738915:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205489408 00000100:00100000:1.0:1788863715.738934:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205489408 00000100:00100000:1.0:1788863715.739203:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:1.0:1788863715.739217:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:11178:x1875759205489408:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863715.739278:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863715.739313:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6916e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187efe expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739458:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739480:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739503:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739546:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739555:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739563:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739780:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739824:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739832:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863715.739860:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788863715.739967:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739976:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739984:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.739990:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863715.739995:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740003:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740018:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863715.740022:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863715.740028:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740036:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69175 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740053:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740068:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740169:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740178:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863715.740182:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740188:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740197:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:1.0:1788863715.740201:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863715.740204:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740210:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6917c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740272:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6916e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 36 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740288:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 35 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.740304:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863715.740306:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863715.740315:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fa00, rc 0) 00000100:00100000:1.0:1788863715.740508:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:11178:x1875759205489408:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1293us (2847us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788863715.740517:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:3.0:1788863715.751355:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863715.751720:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205489536 00000100:00100000:1.0:1788863715.751735:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205489536 00000100:00100000:1.0:1788863715.751826:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:1.0:1788863715.751838:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:11178:x1875759205489536:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:1.0:1788863715.751931:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.751954:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.751969:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.752018:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.752027:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.752035:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.752041:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863715.752047:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.752055:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.757065:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863715.757070:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863715.757095:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.757105:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863715.757365:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:11178:x1875759205489536:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 5521us (6027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863715.757377:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:3.0:1788863715.761567:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863715.761759:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205489792 00000100:00100000:2.0:1788863715.761775:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205489792 00000100:00100000:2.0:1788863715.761848:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:2.0:1788863715.761861:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:11178:x1875759205489792:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788863715.762242:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:11178:x1875759205489792:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 381us (688us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788863715.762319:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:1.0:1788863715.819472:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863715.819503:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226555520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863715.819616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863715.819833:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226555648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863715.819856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863715.824148:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226555520 00000100:00100000:3.0:1788863715.824181:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226555520 00000100:00100000:0.0:1788863715.825048:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226555648 00000100:00100000:0.0:1788863715.825059:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226555648 00000100:00100000:0.0:1788863715.825132:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788863715.825143:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226555520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863715.825213:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1788863715.825361:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226555520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 219us (5744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863715.825369:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788863715.825393:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788863715.825400:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226555648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863715.825421:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863715.825457:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226555648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (5600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863715.825462:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788863715.827678:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226555648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863715.827824:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226555520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863716.136871:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863716.137045:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205490048 00000100:00100000:2.0:1788863716.137060:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205490048 00000100:00100000:2.0:1788863716.137197:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:2.0:1788863716.137210:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:11210:x1875759205490048:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:2.0:1788863716.137243:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863716.137285:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69198 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f05 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.137437:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6919f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.137454:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6919f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.137471:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6919f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863716.137484:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788863716.137634:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69198 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f05 expref: 39 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.137655:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6919f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f05 expref: 38 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.137664:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863716.137667:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863716.137670:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98600, rc 0) 00000100:00100000:2.0:1788863716.137754:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:11210:x1875759205490048:12345-192.168.204.35@tcp:101:cat.0 Request processed in 547us (902us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788863716.137760:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00080000:0.0:1788863716.138856:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863716.150506:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863716.150890:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205490304 00000100:00100000:2.0:1788863716.150905:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205490304 00000100:00100000:2.0:1788863716.150993:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1788863716.151004:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:11210:x1875759205490304:12345-192.168.204.35@tcp:35:cat.0 00000100:00100000:2.0:1788863716.151735:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:11210:x1875759205490304:12345-192.168.204.35@tcp:35:cat.0 Request processed in 726us (1238us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788863716.151749:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1788863716.166781:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863716.170964:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205490432 00000100:00100000:2.0:1788863716.170989:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205490432 00000100:00100000:2.0:1788863716.171153:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:2.0:1788863716.171167:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:2408:x1875759205490432:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863716.171188:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863716.171222:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6919f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f05 expref: 39 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.171248:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863716.171255:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863716.171362:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:2408:x1875759205490432:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 199us (4598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863716.171371:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:1.0:1788863716.329455:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863716.329596:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205490688 00000100:00100000:3.0:1788863716.329610:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205490688 00000100:00100000:3.0:1788863716.329889:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:3.0:1788863716.329908:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:11216:x1875759205490688:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1788863716.329952:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863716.329959:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788863716.330045:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187edb expref: 38 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.330161:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863716.330171:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863716.330197:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f0c expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.330403:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.330421:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 38 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.330431:0:10368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.330474:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 38 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.330514:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 38 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863716.330531:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226555776:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863716.330920:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863716.346173:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863716.347035:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205490816 00000100:00100000:2.0:1788863716.347054:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205490816 00010000:00010000:2.0:1788863716.347196:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 39 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863716.347276:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:2.0:1788863716.347292:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:2408:x1875759205490816:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863716.347313:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863716.347330:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 39 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.347381:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 39 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.347412:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863716.347419:0:10356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.347431:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.347440:0:10356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.347469:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863716.347550:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:2408:x1875759205490816:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 263us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863716.347559:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 55 00010000:00010000:3.0:1788863716.352843:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187efe expref: 38 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863716.352880:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226555776:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863716.352925:0:10368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.352939:0:10368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.352946:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863716.352980:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788863716.353941:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 39 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.353967:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 38 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.353978:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:3.0:1788863716.353998:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788863716.354002:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167da00, rc 0) 00000100:00100000:3.0:1788863716.354620:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:11216:x1875759205490688:12345-192.168.204.35@tcp:101:dd.0 Request processed in 24710us (25172us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788863716.354658:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:0.0:1788863716.363389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863716.363578:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205490944 00000100:00100000:2.0:1788863716.363596:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205490944 00000100:00100000:2.0:1788863716.363718:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:2.0:1788863716.363735:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:11216:x1875759205490944:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788863716.363800:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863716.363838:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f13 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.363896:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.363960:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.363991:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.364366:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.364399:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 39 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.364413:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863716.364418:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788863716.364424:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99c00, rc 0) 00000100:00100000:2.0:1788863716.364548:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:11216:x1875759205490944:12345-192.168.204.35@tcp:101:dd.0 Request processed in 818us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863716.364561:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:1.0:1788863716.380153:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863716.380578:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205491200 00000100:00100000:3.0:1788863716.380596:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205491200 00000100:00100000:3.0:1788863716.380702:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788863716.380725:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:11216:x1875759205491200:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:3.0:1788863716.381307:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.381347:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.381512:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863716.381577:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788863716.381606:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c22d6e1e reply state 00000000972d715a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.381621:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.381629:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:3.0:1788863716.381632:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863716.381636:0:6538:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863716.381775:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+42:11216:x1875759205491200:12345-192.168.204.35@tcp:36:dd.0 Request processed in 1057us (1704us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788863716.381801:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000020:00080000:3.0:1788863716.381809:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788863716.523746:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863716.783897:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863716.784047:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205491328 00000100:00100000:3.0:1788863716.784061:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205491328 00000100:00100000:3.0:1788863716.784195:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788863716.784214:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+42:11230:x1875759205491328:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:3.0:1788863716.784248:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863716.784275:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b691d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f1a expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.784594:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.784615:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.784629:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.784642:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.784650:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.784656:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.786186:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.786256:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 43 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.786268:0:10368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.786340:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 43 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.786904:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 43 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863716.786925:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226555904:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863716.792252:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863716.795906:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226555904:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863716.795955:0:10368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863716.796663:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863716.796824:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205491584 00000100:00100000:3.0:1788863716.796835:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205491584 00000100:00100000:3.0:1788863716.796911:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:3.0:1788863716.796923:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+44:6186:x1875759205491584:12345-192.168.204.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788863716.797473:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:6186:x1875759205491584:12345-192.168.204.35@tcp:35:ldlm_bl.0 Request processed in 551us (811us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788863716.797482:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1788863716.808573:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863716.809026:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205491712 00000100:00100000:2.0:1788863716.809043:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205491712 00010000:00010000:2.0:1788863716.809155:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 45 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863716.809202:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:2.0:1788863716.809214:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:2408:x1875759205491712:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863716.809234:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863716.809242:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 45 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.809280:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 45 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.809324:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b691b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f0c expref: 45 pid: 10368 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.809346:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863716.809352:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.809365:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.809374:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.809416:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863716.809501:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+44:2408:x1875759205491712:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 289us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863716.809510:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 56 00010000:00010000:3.0:1788863716.809601:0:10368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809618:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863716.809714:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788863716.809719:0:10368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863716.809770:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809787:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809798:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809807:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809815:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809822:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167c200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863716.809827:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809836:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809846:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863716.809850:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863716.809854:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809873:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b691de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809888:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809894:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809900:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809906:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863716.809909:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809916:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809924:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:3.0:1788863716.809926:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863716.809930:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809936:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.809975:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b691d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f1a expref: 44 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.810004:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f1a expref: 43 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.810013:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:3.0:1788863716.810015:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863716.810018:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031400, rc 0) 00000100:00100000:3.0:1788863716.810055:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+43:11230:x1875759205491328:12345-192.168.204.35@tcp:101:stat.0 Request processed in 25843us (26173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.810063:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:1.0:1788863716.912526:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863716.912637:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205491968 00000100:00100000:2.0:1788863716.912651:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205491968 00000100:00100000:2.0:1788863716.912736:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:2.0:1788863716.912748:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+43:11236:x1875759205491968:12345-192.168.204.35@tcp:36:truncate.0 00010000:00010000:2.0:1788863716.912833:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863716.912875:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b691ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f1a expref: 43 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.912922:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863716.912929:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863716.913236:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.913254:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.913266:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863716.913329:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788863716.913351:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075bfa6c1 reply state 0000000094b24f4c transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.913364:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.913371:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863716.913375:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863716.913377:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863716.913532:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:11236:x1875759205491968:12345-192.168.204.35@tcp:36:truncate.0 Request processed in 786us (1019us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788863716.913540:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000020:00080000:2.0:1788863716.913547:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788863717.126298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863717.126513:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205492096 00000100:00100000:3.0:1788863717.126528:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205492096 00000100:00100000:3.0:1788863717.126611:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:3.0:1788863717.126622:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:11250:x1875759205492096:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:3.0:1788863717.126658:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863717.126686:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f21 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126794:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126815:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126831:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126845:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126870:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126878:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126974:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126985:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.126993:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863717.127050:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788863717.127055:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863717.127143:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127159:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127169:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127177:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127184:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127316:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863717.127322:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127331:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127347:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863717.127351:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863717.127356:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127362:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69201 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127378:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127384:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127390:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127395:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863717.127397:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127403:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127422:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:3.0:1788863717.127426:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863717.127429:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127436:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127470:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b691fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 47 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127486:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 46 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863717.127493:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:3.0:1788863717.127496:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863717.127498:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641379e00, rc 0) 00000100:00100000:3.0:1788863717.127598:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:11250:x1875759205492096:12345-192.168.204.35@tcp:101:stat.0 Request processed in 976us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863717.127607:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:3.0:1788863717.262608:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.263371:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205492352 00000100:00100000:1.0:1788863717.263406:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205492352 00000100:00100000:1.0:1788863717.263503:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:1.0:1788863717.263516:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:11260:x1875759205492352:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863717.263542:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863717.263571:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69216 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f28 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863717.263707:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788863717.263870:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69216 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f28 expref: 48 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.263888:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:1.0:1788863717.263891:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863717.263897:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69216 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f28 expref: 48 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.263916:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e800, rc 0) 00000100:00100000:1.0:1788863717.264019:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+47:11260:x1875759205492352:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 505us (1426us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1788863717.264027:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:1.0:1788863717.276662:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.276783:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205492608 00000100:00100000:2.0:1788863717.276799:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205492608 00000100:00100000:2.0:1788863717.276879:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1788863717.276891:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+47:11260:x1875759205492608:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788863717.277623:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+48:11260:x1875759205492608:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 730us (975us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788863717.277635:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:3.0:1788863717.374234:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.374691:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205492864 00000100:00100000:1.0:1788863717.374705:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205492864 00000100:00100000:1.0:1788863717.374774:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:1.0:1788863717.374785:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+48:11266:x1875759205492864:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863717.374819:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863717.374846:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69224 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f2f expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.375043:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.375063:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 49 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.375424:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.375477:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 49 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.375495:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 49 pid: 6538 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863717.375513:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226556032:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863717.375664:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e661f31780 going to sleep for 11 seconds 00000100:00100000:1.0:1788863717.379070:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226556032:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863717.379216:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863717.388905:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.391474:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205492992 00000100:00100000:2.0:1788863717.391496:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205492992 00010000:00010000:2.0:1788863717.391572:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 50 pid: 6538 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863717.391639:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:2.0:1788863717.391650:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e448050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+50:2408:x1875759205492992:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863717.391671:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863717.391679:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 50 pid: 6538 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.391695:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 50 pid: 6538 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.391725:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b6920f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f21 expref: 50 pid: 6538 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.391751:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863717.391757:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.391769:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.391778:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.391839:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863717.392039:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.392048:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863717.392113:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788863717.392341:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69224 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 51 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.392363:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 50 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.392371:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863717.392374:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863717.392377:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ec00, rc 0) 00000100:00100000:2.0:1788863717.392479:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e448050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+50:2408:x1875759205492992:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 829us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863717.392489:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:1.0:1788863717.392658:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+49:11266:x1875759205492864:12345-192.168.204.35@tcp:101:bash.0 Request processed in 17874us (18440us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788863717.392667:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:3.0:1788863717.399836:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.400459:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205493248 00000100:00100000:2.0:1788863717.400474:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205493248 00000100:00100000:2.0:1788863717.400605:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788863717.400619:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+49:11266:x1875759205493248:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:2.0:1788863717.400953:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.400977:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.400993:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863717.401047:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788863717.401311:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccf6a218 reply state 000000001f3211a4 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.401335:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.401345:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863717.401348:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863717.401353:0:6538:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863717.401483:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+52:11266:x1875759205493248:12345-192.168.204.35@tcp:36:bash.0 Request processed in 866us (1662us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788863717.401521:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000020:00080000:2.0:1788863717.401528:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788863717.406285:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.406495:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205493376 00000100:00100000:1.0:1788863717.406510:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205493376 00000100:00100000:1.0:1788863717.406592:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:1.0:1788863717.406606:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+52:11266:x1875759205493376:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863717.406640:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863717.406667:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f36 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.407197:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.407218:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 53 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.407228:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.407283:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 53 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.407299:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 53 pid: 6536 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863717.407332:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226556160:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863717.407822:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e661f31780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863717.412059:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863717.412638:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205493504 00000100:00100000:0.0:1788863717.412672:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205493504 00000100:00100000:1.0:1788863717.412891:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226556160:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863717.412942:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.412985:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 54 pid: 6536 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863717.413166:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:0.0:1788863717.413179:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:2409:x1875759205493504:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863717.413201:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863717.413209:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 54 pid: 6536 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.413224:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 54 pid: 6536 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.413254:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6922b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f2f expref: 54 pid: 6536 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.413278:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:0.0:1788863717.413285:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.413298:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.413329:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.413368:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863717.413454:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:2409:x1875759205493504:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 277us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863717.413475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00010000:00010000:1.0:1788863717.413515:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.413526:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863717.413602:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788863717.413608:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863717.413633:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.413674:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f36 expref: 53 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.413693:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f36 expref: 52 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.413714:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863717.413718:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863717.413721:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ea00, rc 0) 00000100:00100000:1.0:1788863717.413769:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+52:11266:x1875759205493376:12345-192.168.204.35@tcp:101:bash.0 Request processed in 7167us (7500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863717.413778:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788863717.422384:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.422442:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205493760 00000100:00100000:1.0:1788863717.422455:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205493760 00000100:00100000:1.0:1788863717.422518:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:1.0:1788863717.422527:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+52:11266:x1875759205493760:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:1.0:1788863717.422827:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:11266:x1875759205493760:12345-192.168.204.35@tcp:35:bash.0 Request processed in 300us (456us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788863717.422836:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:3.0:1788863717.503960:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.504112:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205494016 00000100:00100000:1.0:1788863717.504124:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205494016 00000100:00100000:1.0:1788863717.504197:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:1.0:1788863717.504208:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:11276:x1875759205494016:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863717.504234:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863717.504256:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6924e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f3d expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863717.504380:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788863717.504486:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6924e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f3d expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.504514:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:1.0:1788863717.504517:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863717.504522:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6924e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f3d expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.504540:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e800, rc 0) 00000100:00100000:1.0:1788863717.504615:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:11276:x1875759205494016:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 409us (667us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788863717.504623:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788863717.510409:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.510640:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205494144 00000100:00100000:2.0:1788863717.510651:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205494144 00000100:00100000:2.0:1788863717.510721:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:2.0:1788863717.510734:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:11276:x1875759205494144:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:2.0:1788863717.510824:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510842:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510854:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510865:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510872:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510877:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510948:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510957:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.510982:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863717.511032:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511046:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511052:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511071:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511107:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863717.511111:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511119:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511131:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788863717.511134:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863717.511139:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511145:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6925c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511156:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511170:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511175:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511180:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863717.511183:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511189:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511198:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:2.0:1788863717.511200:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863717.511203:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511208:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511217:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511223:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511229:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511233:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863717.511242:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511248:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511256:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863717.511258:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863717.511260:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.511266:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6926a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863717.511360:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:11276:x1875759205494144:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 627us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863717.511368:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:0.0:1788863717.515001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.515346:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205494400 00000100:00100000:2.0:1788863717.515358:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205494400 00000100:00100000:2.0:1788863717.515422:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:2.0:1788863717.515433:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:11276:x1875759205494400:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788863717.515694:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:11276:x1875759205494400:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 263us (701us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788863717.515701:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00010000:00010000:2.0:1788863717.549235:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863717.580169:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.582528:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205494656 00000100:00100000:1.0:1788863717.582547:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205494656 00000100:00100000:1.0:1788863717.582716:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:1.0:1788863717.582729:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:11279:x1875759205494656:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863717.582761:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863717.582782:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69271 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f44 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.582864:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.582881:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.582893:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.582904:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.582927:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.582934:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583071:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583104:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583111:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863717.583121:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788863717.583213:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583221:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583228:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583234:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.583239:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583245:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583272:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863717.583275:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.583280:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583307:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69278 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583323:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583329:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583335:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583340:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.583342:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583347:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583354:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:1.0:1788863717.583357:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.583360:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583366:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6927f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583421:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69271 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f44 expref: 58 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583438:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f44 expref: 57 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.583445:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863717.583447:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863717.583450:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863717.583527:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+57:11279:x1875759205494656:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 802us (3562us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788863717.583535:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:3.0:1788863717.593419:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863717.593465:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.593546:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205494784 00000100:00100000:1.0:1788863717.593559:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205494784 00000100:00100000:1.0:1788863717.593624:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:1.0:1788863717.593634:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+57:11279:x1875759205494784:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:1.0:1788863717.593718:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.593738:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.593751:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.593787:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863717.593926:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205494912 00000100:00100000:0.0:1788863717.593931:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205494912 00000100:00100000:0.0:1788863717.593981:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:0.0:1788863717.593990:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+58:2409:x1875759205494912:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863717.594001:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863717.594527:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.594534:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.595419:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.595431:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.595443:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.595462:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863717.595464:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863717.595470:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.595481:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.595676:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f44 expref: 58 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863717.595691:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:0.0:1788863717.595694:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863717.595744:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+57:11279:x1875759205494784:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 2110us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863717.595754:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:0.0:1788863717.595897:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+56:2409:x1875759205494912:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 1907us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863717.595905:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:3.0:1788863717.600575:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.600709:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205495168 00000100:00100000:1.0:1788863717.600734:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205495168 00000100:00100000:1.0:1788863717.600789:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1788863717.600800:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+56:11279:x1875759205495168:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863717.601068:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+57:11279:x1875759205495168:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 269us (506us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788863717.601116:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000001:00080000:0.0:1788863717.612884:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1788863717.612961:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788863717.612992:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e650de2a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788863717.612998:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e54413ea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e67ae14540 00000020:00080000:0.0:1788863717.613001:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e54413eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e5438e5200 00000020:00080000:3.0:1788863717.613391:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788863717.613674:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1788863717.614126:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614144:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614152:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614159:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.614164:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614172:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614192:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89e643aa2a00) 00010000:00010000:1.0:1788863717.614195:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.614200:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614206:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69080 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614235:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614242:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614272:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614276:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.614279:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614307:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614317:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863717.614320:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.614323:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614328:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69087 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614345:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614352:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614358:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614376:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ee00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.614379:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614396:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614406:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2400) 00010000:00010000:1.0:1788863717.614408:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.614412:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614418:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b690c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614434:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614440:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614445:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614450:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.614453:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614458:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614465:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863717.614467:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.614470:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614485:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b691d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614498:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614503:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614509:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614514:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.614518:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614524:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614533:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863717.614536:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.614539:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614545:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b691f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614555:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614561:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614575:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614580:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863717.614583:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.614589:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.615595:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:1.0:1788863717.615611:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863717.615616:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.615624:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69239 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863717.616319:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226556288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788863717.616394:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863717.616539:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226556288 00000100:00100000:2.0:1788863717.616546:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226556288 00000100:00100000:2.0:1788863717.616613:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863717.616624:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226556288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788863717.616667:0:8606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788863717.616701:0:8606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9fe4e3, atime: 0x6a9fe4e3, ctime: 0x6a9fe4e3, blocks: 0x8 00010000:00010000:2.0:1788863717.616709:0:8606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.616738:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788863717.616743:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863717.616749:0:8606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.616766:0:8606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.616776:0:8606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.616783:0:8606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.616804:0:8606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788863717.616952:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226556288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 331us (558us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788863717.616960:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788863717.616992:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863717.616998:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.617018:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863717.617023:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.617033:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.617049:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.617055:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf7df49/0xf569beb9d4b6929b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.617072:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863717.617113:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863717.617115:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788863717.617157:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e543bf3800/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788863717.617163:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226556288:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788863717.617546:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863717.788146:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.788236:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205495424 00000100:00100000:2.0:1788863717.788251:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205495424 00000100:00100000:2.0:1788863717.788360:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:2.0:1788863717.788374:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:11297:x1875759205495424:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:2.0:1788863717.788399:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863717.788421:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f4b expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.788550:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b692a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.788565:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b692a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.788578:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b692a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863717.788590:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788863717.788741:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f4b expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.788761:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b692a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f4b expref: 14 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.788770:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863717.788773:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788863717.789449:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99600, rc 0) 00000100:00100000:2.0:1788863717.789537:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11297:x1875759205495424:12345-192.168.204.35@tcp:101:cat.0 Request processed in 1164us (1459us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788863717.789545:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:3.0:1788863717.832027:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.832735:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205495552 00000100:00100000:1.0:1788863717.832751:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205495552 00000100:00100000:1.0:1788863717.832950:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:1.0:1788863717.832963:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11298:x1875759205495552:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863717.832996:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863717.833025:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f52 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.833159:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b692be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.833211:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b692be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.833226:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b692be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863717.833284:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788863717.833289:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863717.833325:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b692be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.833361:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f52 expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.833399:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b692be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f52 expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.833410:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863717.833414:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863717.833419:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f800, rc 0) 00000100:00100000:1.0:1788863717.833518:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11298:x1875759205495552:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 557us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863717.833526:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:3.0:1788863717.843631:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.848570:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205495936 00000100:00100000:1.0:1788863717.848598:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205495936 00000100:00100000:1.0:1788863717.848703:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:1.0:1788863717.848717:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11298:x1875759205495936:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863717.849652:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11298:x1875759205495936:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 932us (6034us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788863717.849686:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:0.0:1788863717.858876:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.859165:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205496064 00000100:00100000:2.0:1788863717.859179:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205496064 00000100:00100000:2.0:1788863717.859299:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:2.0:1788863717.859311:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11298:x1875759205496064:12345-192.168.204.35@tcp:103:lfs.0 00010000:00010000:2.0:1788863717.859332:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788863717.859400:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f36 expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.859436:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b692a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f4b expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.859452:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b69144 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ef0 expref: 14 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.859464:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863717.859472:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863717.859561:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:11298:x1875759205496064:12345-192.168.204.35@tcp:103:lfs.0 Request processed in 252us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863717.859572:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1788863717.863741:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863717.863934:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205496192 00000100:00100000:1.0:1788863717.863947:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205496192 00000100:00100000:1.0:1788863717.864027:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:1.0:1788863717.864040:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:11298:x1875759205496192:12345-192.168.204.35@tcp:58:lfs.0 00010000:00010000:1.0:1788863717.864498:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.864523:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863717.864542:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863717.873976:0:10368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863717.875129:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788863717.875514:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788863717.875669:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:11298:x1875759205496192:12345-192.168.204.35@tcp:58:lfs.0 Request processed in 11623us (11935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863717.875683:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:3.0:1788863717.922915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863717.923023:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205496320 00000100:00100000:2.0:1788863717.923043:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205496320 00000100:00100000:2.0:1788863717.923280:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:2.0:1788863717.923310:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:11300:x1875759205496320:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863717.923340:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863717.923513:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b692cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f59 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923591:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923607:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923620:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923661:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923669:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923675:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923766:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923776:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923784:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863717.923826:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788863717.923831:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863717.923850:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923861:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923869:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923876:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923893:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923899:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863717.923904:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.923912:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924234:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788863717.924240:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863717.924246:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924253:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b692d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924268:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924274:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924281:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924303:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863717.924307:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924337:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924347:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e542bf3800) 00010000:00010000:2.0:1788863717.924349:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863717.924352:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924357:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b692da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924398:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b692cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924414:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 14 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863717.924420:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863717.924422:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863717.924425:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:2.0:1788863717.924506:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11300:x1875759205496320:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1213us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863717.924517:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000040:00080000:1.0:1788863718.512863:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863718.512885:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863718.512933:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788863718.512948:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863718.513178:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f805880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226556416:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788863718.513324:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863718.524221:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f805880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226556416:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788863718.531745:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.532649:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205496448 00000100:00100000:1.0:1788863718.532666:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205496448 00000100:00100000:1.0:1788863718.532987:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:1.0:1788863718.533006:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205496448:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788863718.533054:0:6537:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788863718.533262:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205496448:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 261us (1531us total) trans 0 rc 0/0 00000100:00080000:0.0:1788863718.535093:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863718.535641:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:3.0:1788863718.539998:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.540152:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205496576 00000100:00100000:1.0:1788863718.540173:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205496576 00000100:00100000:1.0:1788863718.540246:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:1.0:1788863718.540259:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205496576:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788863718.540372:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.540395:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.540410:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.545639:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.545711:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.545729:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.545777:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.545788:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.545796:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863718.545961:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788863718.545966:0:10368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863718.545992:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.546007:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.546014:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.546022:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.546029:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.546034:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.546049:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.546066:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:0.0:1788863718.546069:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863718.549806:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.549834:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b692e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.549868:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.549875:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550381:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550395:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.550401:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550411:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550439:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff89e6625ebd00) 00010000:00010000:0.0:1788863718.550444:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863718.550450:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550486:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b692ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550511:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550517:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550523:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550528:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.550531:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550537:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550546:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:0.0:1788863718.550548:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863718.550552:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.550557:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b692f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863718.550985:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205496576:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 Request processed in 10719us (11103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863718.551000:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:1.0:1788863718.555585:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.555710:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205496832 00000100:00100000:2.0:1788863718.555727:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205496832 00000100:00100000:2.0:1788863718.555846:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:2.0:1788863718.555860:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205496832:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863718.555919:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863718.555948:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b692fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f60 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557577:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557609:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557641:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863718.557657:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788863718.557779:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557787:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557795:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557802:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.557808:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557816:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557832:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:0.0:1788863718.557836:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863718.557841:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557847:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69304 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557916:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b692fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f60 expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557941:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:0.0:1788863718.557943:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863718.557947:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b692fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f60 expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.557959:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98600, rc 0) 00000100:00100000:0.0:1788863718.558049:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205496832:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 2193us (2480us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1788863718.558060:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:0.0:1788863718.563058:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863718.563294:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205496960 00000100:00100000:3.0:1788863718.563308:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205496960 00000100:00100000:3.0:1788863718.563390:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:3.0:1788863718.563401:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205496960:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788863718.563451:0:6536:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788863718.563621:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205496960:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 221us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.563630:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 81 00010000:00010000:0.0:1788863718.571365:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863718.601113:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.601214:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205497216 00000100:00100000:0.0:1788863718.601228:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205497216 00000100:00100000:0.0:1788863718.601320:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:0.0:1788863718.601332:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205497216:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863718.601359:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863718.601363:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788863718.601398:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b692be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f52 expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.601423:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863718.601429:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863718.601446:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69312 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f67 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863718.601994:0:10368:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788863718.602251:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.602268:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.602294:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.602367:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69312 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f67 expref: 17 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.602385:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f67 expref: 16 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.602394:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:0.0:1788863718.602397:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863718.602399:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90800, rc 0) 00000100:00100000:0.0:1788863718.602479:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11311:x1875759205497216:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1416us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788863718.602488:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:3.0:1788863718.609577:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.609703:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205497472 00000100:00100000:0.0:1788863718.609718:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205497472 00000100:00100000:0.0:1788863718.609838:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:0.0:1788863718.609850:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11311:x1875759205497472:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788863718.609937:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863718.609975:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69319 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f67 expref: 16 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610024:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e6625ebd00) 00010000:00010000:0.0:1788863718.610038:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863718.610069:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610119:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610130:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610163:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610178:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610185:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610252:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610260:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610267:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610273:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.610290:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610306:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610316:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863718.610319:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863718.610324:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610330:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b69327 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610340:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610345:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610352:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610357:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.610360:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610367:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610373:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x15fa43d8 (ffff89e6625eb200) 00010000:00010000:0.0:1788863718.610376:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863718.610378:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.610395:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b6932e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x15fa43d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863718.610507:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205497472:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 659us (945us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863718.610516:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:2.0:1788863718.619966:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863718.620112:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205497600 00000100:00100000:3.0:1788863718.620127:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205497600 00000100:00100000:3.0:1788863718.620222:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 84 00000100:00100000:3.0:1788863718.620235:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205497600:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863718.620285:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863718.620319:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b69335 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f6e expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.620367:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.620386:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.620401:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.620550:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b69335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 17 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.620576:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 16 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.620588:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:3.0:1788863718.620592:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863718.620595:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641379c00, rc 0) 00000100:00100000:3.0:1788863718.620680:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11311:x1875759205497600:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 448us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.620688:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 84 00000100:00100000:3.0:1788863718.625239:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.625440:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205497856 00000100:00100000:1.0:1788863718.625454:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205497856 00000100:00100000:1.0:1788863718.625531:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 85 00000100:00100000:1.0:1788863718.625552:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11311:x1875759205497856:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788863718.626905:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.626936:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.626953:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863718.627272:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788863718.627309:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385751232294ns, next at 386751219704ns, rc = 0 00000004:00010000:1.0:1788863718.627382:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b5a7f0e reply state 00000000eae4d2ae transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.627398:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.627407:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:1.0:1788863718.627411:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788863718.627416:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863718.627592:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:11311:x1875759205497856:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 2039us (2363us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788863718.627602:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 85 00000100:00100000:3.0:1788863718.631920:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.632847:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205497984 00000100:00100000:0.0:1788863718.632864:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205497984 00000100:00100000:0.0:1788863718.632959:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:0.0:1788863718.632971:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:11311:x1875759205497984:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863718.633007:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863718.633035:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f75 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.634071:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.634888:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.634931:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:0.0:1788863718.634935:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863718.634940:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d91a00, rc 0) 00000100:00100000:0.0:1788863718.635043:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11311:x1875759205497984:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 2073us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863718.635053:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:0.0:1788863718.642244:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863718.643197:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205498112 00000100:00100000:3.0:1788863718.643234:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205498112 00000100:00100000:3.0:1788863718.643322:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:3.0:1788863718.643333:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1875759205498112:12345-192.168.204.35@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788863718.643381:0:8452:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:3.0:1788863718.643427:0:8452:0:(genops.c:1384:class_connect()) connect: client 7a6822fa-e36f-4316-b7e3-4bba6134cbda, cookie 0xf569beb9d4b69351 00002000:00100000:3.0:1788863718.643443:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a6822fa-e36f-4316-b7e3-4bba6134cbda/ffff89e67f895000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788863718.643466:0:8452:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1788863718.643594:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788863718.644431:0:8452:0:(import.c:65:import_set_state_nolock()) ffff89e67f897800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863718.644548:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2407:x1875759205498112:12345-192.168.204.35@tcp:8:lhsmtool_posix.0 Request processed in 1211us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.644559:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:3.0:1788863718.649897:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.650378:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205498240 00000100:00100000:0.0:1788863718.650396:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205498240 00000100:00100000:0.0:1788863718.650486:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:0.0:1788863718.650498:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:0:x1875759205498240:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788863718.650505:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788863718.662502:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1788863718.662526:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000100:00100000:0.0:1788863718.662951:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:0:x1875759205498240:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 12445us (13068us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788863718.662965:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:3.0:1788863718.669773:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.670707:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205498496 00000100:00100000:1.0:1788863718.670725:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205498496 00000100:00100000:1.0:1788863718.670803:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:1.0:1788863718.670828:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11311:x1875759205498496:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788863718.671519:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11311:x1875759205498496:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 691us (1760us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788863718.671529:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:0.0:1788863718.677943:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.678065:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205498752 00000100:00100000:2.0:1788863718.678109:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205498752 00000100:00100000:2.0:1788863718.678200:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:2.0:1788863718.678212:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11311:x1875759205498752:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788863718.678372:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11311:x1875759205498752:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 162us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.678381:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:0.0:1788863718.685855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.687020:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205498880 00000100:00100000:1.0:1788863718.687036:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205498880 00000100:00100000:1.0:1788863718.687143:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 88 00000100:00100000:1.0:1788863718.687176:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11311:x1875759205498880:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863718.687203:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863718.687230:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69358 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f7c expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.687339:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6935f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.687360:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6935f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.687377:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6935f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863718.687439:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863718.687465:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6935f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.687495:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69358 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f7c expref: 22 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.687516:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6935f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f7c expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.687544:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:1.0:1788863718.687548:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788863718.687553:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e200, rc 0) 00000100:00100000:1.0:1788863718.687638:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11311:x1875759205498880:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 472us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863718.687646:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 88 00000100:00100000:0.0:1788863718.696881:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863718.697025:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205499008 00000100:00100000:3.0:1788863718.697038:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205499008 00000100:00100000:3.0:1788863718.697133:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:3.0:1788863718.697270:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205499008:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863718.697316:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863718.697361:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f83 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863718.697399:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe4e6, blocks: 0x0 00010000:00010000:3.0:1788863718.697427:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1788863718.697432:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863718.697445:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 6 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.697488:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 6 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.697505:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641378400, rc 0) 00000100:00100000:3.0:1788863718.697589:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205499008:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 446us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.697597:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:0.0:1788863718.709446:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.709568:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205499264 00000100:00100000:1.0:1788863718.709583:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205499264 00000100:00100000:2.0:1788863718.709870:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 89 00000100:00100000:2.0:1788863718.709886:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11311:x1875759205499264:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788863718.710042:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11311:x1875759205499264:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 151us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.710051:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 89 00000100:00100000:3.0:1788863718.722038:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.723375:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205499392 00000100:00100000:2.0:1788863718.723391:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205499392 00000100:00100000:2.0:1788863718.723465:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:2.0:1788863718.723477:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:11311:x1875759205499392:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863718.723500:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863718.723526:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f8a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.723593:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.723605:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863718.723610:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863718.723616:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.723678:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.724418:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 7 pid: 8452 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.724448:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226556544:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863718.724603:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863718.728393:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226556544:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863718.728447:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.728476:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99600, rc 0) 00000100:00100000:3.0:1788863718.728561:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:11311:x1875759205499392:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 5084us (6538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.728573:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:3.0:1788863718.732112:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.732295:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205499520 00000100:00100000:2.0:1788863718.732307:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205499520 00010000:00010000:2.0:1788863718.732358:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 7 pid: 8452 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.732410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:2.0:1788863718.732422:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205499520:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863718.732439:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863718.732486:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 7 pid: 8452 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.732502:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 7 pid: 8452 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.732534:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69366 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f83 expref: 7 pid: 8452 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.732552:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863718.732556:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863718.732566:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.732577:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.732623:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.732646:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6524:1875759226556672:192.168.204.35@tcp:105: 00000100:00100000:2.0:1788863718.734018:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863718.740175:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6524:1875759226556672:192.168.204.35@tcp:105: 00010000:00010000:3.0:1788863718.740211:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863718.740308:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205499520:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 7887us (8233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.740321:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:2.0:1788863718.745141:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.745538:0:8458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205499648 00000100:00100000:0.0:1788863718.745553:0:8458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205499648 00002000:00100000:0.0:1788863718.745641:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff89e542ae5180 x1875759205499648/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:704/0 lens 504/0 e 0 to 0 dl 1788863729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863718.745655:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e542ae5180 with x1875759205499648 ext(0->8) 00002000:00010000:0.0:1788863718.745663:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e542ae5180 00000100:00100000:0.0:1788863718.745706:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1788863718.745718:0:8458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205499648:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788863718.752824:0:8458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205499648:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 Request processed in 7087us (8439us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788863718.752844:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00002000:00100000:0.0:1788863718.752866:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff89e542ae5180 x1875759205499648/t4294967303(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:704/0 lens 504/448 e 0 to 0 dl 1788863729 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863718.752893:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e542ae5180 with x1875759205499648 ext(0->8) 00002000:00010000:0.0:1788863718.752902:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e542ae5180 00000100:00100000:0.0:1788863718.760061:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.762397:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205499776 00000100:00100000:1.0:1788863718.762420:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205499776 00000100:00100000:1.0:1788863718.762508:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:1.0:1788863718.762610:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11311:x1875759205499776:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788863718.769107:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788863718.769134:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:0.0:1788863718.769256:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.769271:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.769291:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.769299:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.769305:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.769314:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.769339:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:0.0:1788863718.769342:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788863718.769348:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.769355:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69343 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788863718.769410:0:6516:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1788863718.769649:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863718.769810:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226556800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788863718.769906:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788863718.769991:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788863718.770008:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788863718.770028:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226556800 00000100:00100000:0.0:1788863718.770045:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226556800 00000100:00100000:0.0:1788863718.770154:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788863718.770176:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226556800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788863718.770353:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788863718.770357:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788863719 00002000:00010000:0.0:1788863718.770360:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788863718.770363:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788863718 -> 1788863719 00002000:00010000:0.0:1788863718.770366:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788863718.770438:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226556800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (532us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788863718.770446:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788863718.770498:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e5440c0380/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788863718.770505:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226556800:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788863718.771501:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863718.773058:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205499776:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 Request processed in 10438us (12996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863718.773096:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:3.0:1788863718.783473:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.784293:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205499904 00000100:00100000:0.0:1788863718.784308:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205499904 00000100:00100000:0.0:1788863718.784384:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:0.0:1788863718.784397:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205499904:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788863718.791421:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788863718.791449:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788863718.792397:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205499904:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 Request processed in 7990us (8927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863718.792413:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:1.0:1788863718.802624:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863718.802828:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205500160 00000100:00100000:3.0:1788863718.802841:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205500160 00000100:00100000:3.0:1788863718.802917:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00100000:3.0:1788863718.802928:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205500160:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863718.803011:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863718.803045:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6935f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f7c expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.803071:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:3.0:1788863718.803103:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863718.803142:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.803160:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.803183:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863718.803362:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d86f063 reply state 00000000367e68cb transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.803376:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.803382:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:3.0:1788863718.803385:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863718.803388:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863718.803542:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205500160:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 603us (919us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788863718.803570:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00100000:0.0:1788863718.811437:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.811490:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205500288 00000100:00100000:0.0:1788863718.811504:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205500288 00000100:00100000:0.0:1788863718.811589:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:0.0:1788863718.811601:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205500288:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788863718.811839:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788863718.811844:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788863719 -> 1788863717 00002000:00010000:0.0:1788863718.811847:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788863715 00002000:00010000:0.0:1788863718.811850:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788863719 -> 1788863717 00002000:00010000:0.0:1788863718.811852:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788863718.811933:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205500288:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 334us (511us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788863718.811942:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:1.0:1788863718.817605:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.817801:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205500544 00000100:00100000:2.0:1788863718.817815:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205500544 00000100:00100000:2.0:1788863718.817894:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 92 00000100:00100000:2.0:1788863718.817907:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:11311:x1875759205500544:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788863718.818000:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.818021:0:12972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 15 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.818032:0:12972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.818108:0:12972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 15 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.818123:0:12972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 15 pid: 12972 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.818140:0:12972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226556928:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863718.831327:0:12972:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077840 going to sleep for 11 seconds 00000100:00100000:0.0:1788863718.839125:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.839476:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205500672 00000100:00100000:2.0:1788863718.839489:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205500672 00010000:00010000:2.0:1788863718.839555:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 16 pid: 12972 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.839602:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:2.0:1788863718.839624:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:2409:x1875759205500672:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863718.839645:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863718.839654:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 16 pid: 12972 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.839681:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 16 pid: 12972 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.839709:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:2.0:1788863718.839716:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.839728:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.839738:0:10355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.839763:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863718.839837:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:2409:x1875759205500672:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 215us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.839846:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00010000:00010000:1.0:1788863718.847717:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6933c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f6e expref: 15 pid: 12972 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863718.847752:0:12972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226556928:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863718.847785:0:12972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.856609:0:12972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.856635:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.861358:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.861393:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.861403:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.861409:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863718.861415:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.861422:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.861446:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:2.0:1788863718.861448:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788863718.861455:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.861461:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6937b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.861599:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205500544:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 Request processed in 43687us (44001us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788863718.861611:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 92 00000100:00100000:2.0:1788863718.865867:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863718.865943:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205500800 00000100:00100000:3.0:1788863718.865956:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205500800 00000100:00100000:3.0:1788863718.866025:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:3.0:1788863718.866035:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205500800:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788863718.866117:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.866143:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.866153:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863718.866158:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863718.866171:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.866214:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863718.866230:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 7 pid: 8451 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863718.866248:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226557056:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863718.866361:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d540900 going to sleep for 11 seconds 00000100:00100000:2.0:1788863718.872352:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226557056:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863718.872396:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.898681:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863718.899151:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205500928 00000100:00100000:0.0:1788863718.899177:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205500928 00010000:00010000:0.0:1788863718.899250:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 8 pid: 8451 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863718.899327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:0.0:1788863718.899341:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205500928:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863718.899363:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863718.899394:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 8 pid: 8451 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.899412:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 8 pid: 8451 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.899449:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000429b406e/0xf569beb9d4b6936d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f8a expref: 8 pid: 8451 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.899495:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788863718.899500:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863718.899507:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.899519:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.899572:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863718.899650:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205500928:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 311us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863718.899669:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00010000:00010000:2.0:1788863718.899944:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.899956:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.899984:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.899994:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.900002:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.900010:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863718.900014:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.900023:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.900038:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.900064:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b6bc5c7/0xf569beb9d4b69382 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.900179:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205500800:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 Request processed in 34145us (34329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.900189:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:0.0:1788863718.908126:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863718.908297:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205501184 00000100:00100000:1.0:1788863718.908346:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205501184 00000100:00100000:1.0:1788863718.908454:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 93 00000100:00100000:1.0:1788863718.908468:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11311:x1875759205501184:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788863718.908602:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.908642:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 14 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.908654:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.908973:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 14 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863718.909001:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 14 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863718.909022:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226557184:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863718.909357:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788863718.932173:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.932287:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205501312 00000100:00100000:2.0:1788863718.932303:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205501312 00010000:00010000:2.0:1788863718.932365:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 15 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.932423:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:2.0:1788863718.932436:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e449c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:2408:x1875759205501312:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863718.932457:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863718.932466:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 15 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.932483:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 15 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.932516:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863718.932523:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.932548:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.932572:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.932598:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863718.932688:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e449c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:2408:x1875759205501312:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 254us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.932696:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00010000:00010000:0.0:1788863718.933137:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b691c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f13 expref: 14 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863718.933158:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226557184:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863718.933182:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.933193:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.933199:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.933455:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.933478:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 14 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.933488:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.933541:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 14 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.933558:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 14 pid: 12972 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863718.933574:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226557312:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863718.933693:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a92840 going to sleep for 11 seconds 00000100:00100000:1.0:1788863718.943104:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.943685:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205501440 00000100:00100000:2.0:1788863718.943701:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205501440 00010000:00010000:2.0:1788863718.943776:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 15 pid: 12972 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.943829:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:2.0:1788863718.943842:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:2409:x1875759205501440:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863718.943864:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863718.943873:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 15 pid: 12972 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.943894:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 15 pid: 12972 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.943930:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:2.0:1788863718.943938:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.943951:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.943985:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.944016:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863718.944137:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:2409:x1875759205501440:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 296us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.944147:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00010000:00010000:0.0:1788863718.954000:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b6934a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f75 expref: 14 pid: 12972 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863718.954044:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226557312:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863718.954104:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.954774:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.954791:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863718.954999:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788863718.958175:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788863718.958312:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788863718.958476:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875759226557440:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788863718.963883:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863718.963956:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642e81180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863718.964169:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226557440 00000100:00100000:0.0:1788863718.964184:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226557440 00000100:00100000:0.0:1788863718.964283:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788863718.964298:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875759226557440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788863718.964465:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875759226557440:12345-0@lo:1000:mdt00_001.0 Request processed in 171us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863718.964485:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788863718.971859:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788863718.971891:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e5440c0380, transno 4294967304 00000100:00100000:2.0:1788863718.971941:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875759226557440:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788863718.972193:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788863718.972311:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875759226557568:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788863718.972416:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863718.972464:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863718.972476:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226557568 00000100:00100000:0.0:1788863718.972485:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226557568 00000100:00100000:0.0:1788863718.972552:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788863718.972566:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875759226557568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788863718.972742:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6537:x1875759226557568:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (327us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788863718.972751:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788863718.972897:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875759226557568:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788863718.972969:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.972981:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.972991:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973010:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863718.973017:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973026:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973047:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:2.0:1788863718.973051:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863718.973057:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973064:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69390 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973133:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973140:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973146:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973389:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ee00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863718.973393:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973399:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973409:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863718.973412:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863718.973415:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973421:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b692c5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973481:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973497:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973508:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973544:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.973560:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 17 pid: 6538 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.973585:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226557696:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863718.973728:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ec8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863718.989929:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863718.990757:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226557696:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863718.990796:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.990856:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205501568 00000100:00100000:2.0:1788863718.990865:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205501568 00010000:00010000:2.0:1788863718.990916:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 18 pid: 6538 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.990957:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:2.0:1788863718.990969:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:2409:x1875759205501568:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863718.990986:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863718.990994:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 18 pid: 6538 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.991007:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 18 pid: 6538 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.991036:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b692e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f59 expref: 18 pid: 6538 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.991054:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:2.0:1788863718.991060:0:10356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.991098:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.991108:0:10356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863718.991133:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863718.991146:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991155:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991171:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991178:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991186:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991193:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.991198:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991207:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991229:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:0.0:1788863718.991232:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863718.991238:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991244:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69397 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991256:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991262:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991280:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991287:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863718.991290:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991297:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991306:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2700) 00010000:00010000:0.0:1788863718.991309:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863718.991312:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863718.991318:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69389 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863718.991465:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:2409:x1875759205501568:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 497us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.991476:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000040:00080000:0.0:1788863718.993197:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863718.993207:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863718.993227:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788863718.993235:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788863718.994089:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11311:x1875759205501184:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 85594us (85993us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788863718.994107:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 93 00000020:00080000:2.0:1788863718.994117:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788863719.016316:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863719.016789:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205501824 00000100:00100000:1.0:1788863719.016811:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205501824 00000100:00100000:1.0:1788863719.016917:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1788863719.016932:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11311:x1875759205501824:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788863719.017376:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788863719.017421:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788863719.017480:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.017504:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.017519:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.017542:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.017549:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.017558:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.017580:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863719.017729:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:11311:x1875759205501824:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 799us (1421us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788863719.017739:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000020:00080000:1.0:1788863719.017749:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863719.018336:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863719.018352:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.018364:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863719.018369:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.018385:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.018405:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:2.0:1788863719.018409:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788863719.018415:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.018442:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6939e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.018461:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863719.018463:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863719.018465:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788863719.154798:0:14229:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863719.154814:0:14229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863719.154856:0:14229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788863719.154866:0:14229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788863719.341757:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.341843:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205502080 00000100:00100000:0.0:1788863719.341854:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205502080 00000100:00100000:0.0:1788863719.341973:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 94 00000100:00100000:0.0:1788863719.341985:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:11321:x1875759205502080:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863719.342017:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863719.342054:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f91 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.342204:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b693ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.342225:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b693ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.342239:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b693ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863719.342251:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788863719.342383:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f91 expref: 21 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.342404:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b693ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f91 expref: 20 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.342438:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863719.342442:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788863719.342446:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90e00, rc 0) 00000100:00100000:0.0:1788863719.342528:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11321:x1875759205502080:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 545us (784us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788863719.342536:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 94 00000100:00100000:0.0:1788863719.347348:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863719.347437:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205502208 00000100:00100000:1.0:1788863719.347447:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205502208 00000100:00100000:1.0:1788863719.347522:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:1.0:1788863719.347533:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11321:x1875759205502208:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:1.0:1788863719.347618:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347648:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347673:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347692:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347699:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347705:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347796:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347804:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347811:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863719.347863:0:12972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347876:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347882:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347888:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347904:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863719.347908:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347916:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347931:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863719.347933:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863719.347938:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347943:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b693ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347959:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347964:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347969:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347974:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863719.347977:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.347983:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348002:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e643aa2300) 00010000:00010000:1.0:1788863719.348004:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863719.348008:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348013:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b693c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348041:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348047:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348052:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348056:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863719.348058:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348062:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348068:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e643aa2a00) 00010000:00010000:1.0:1788863719.348070:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863719.348072:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.348118:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b693c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863719.348217:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11321:x1875759205502208:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 685us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863719.348225:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:0.0:1788863719.404556:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863719.404584:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226557824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863719.404670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863719.407635:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226557824 00000100:00100000:3.0:1788863719.407645:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226557824 00000100:00100000:3.0:1788863719.407731:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788863719.407741:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226557824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863719.408291:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788863719.408397:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226557824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 657us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.408406:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788863719.408435:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863719.408453:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226557952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863719.408493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788863719.408666:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863719.408673:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226557952 00000100:00100000:0.0:1788863719.408681:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226557952 00000100:00100000:3.0:1788863719.408714:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226557824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863719.408716:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788863719.408727:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226557952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863719.408741:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788863719.408780:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226557952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.408787:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788863719.409040:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226557952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863719.442309:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863719.442878:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205502464 00000100:00100000:3.0:1788863719.442890:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205502464 00000100:00100000:3.0:1788863719.442960:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 96 00000100:00100000:3.0:1788863719.442970:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:11325:x1875759205502464:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863719.442992:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863719.443018:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b693cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f98 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443163:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443180:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443211:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443228:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443236:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443243:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443380:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443388:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443395:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863719.443406:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788863719.443620:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443627:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443633:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443639:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863719.443649:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443658:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443671:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863719.443674:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863719.443678:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443685:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b693d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443696:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443701:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443706:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443711:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641379e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863719.443714:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443720:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443727:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:3.0:1788863719.443730:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863719.443740:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443746:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b693dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443789:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b693cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443803:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.443810:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:3.0:1788863719.443813:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863719.443815:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641378400, rc 0) 00000100:00100000:3.0:1788863719.443887:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11325:x1875759205502464:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 917us (1588us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788863719.443895:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 96 00000100:00100000:1.0:1788863719.447612:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.447776:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205502592 00000100:00100000:0.0:1788863719.447788:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205502592 00000100:00100000:0.0:1788863719.447951:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 97 00000100:00100000:0.0:1788863719.447961:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11325:x1875759205502592:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:0.0:1788863719.448036:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448056:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448173:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448215:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448223:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448232:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448238:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863719.448244:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448251:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448277:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:0.0:1788863719.448289:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863719.448295:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.448302:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863719.448378:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11325:x1875759205502592:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 418us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.448387:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 97 00000100:00100000:2.0:1788863719.453525:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.454597:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205502848 00000100:00100000:0.0:1788863719.454633:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205502848 00000100:00100000:0.0:1788863719.454701:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:0.0:1788863719.454711:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bda850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11325:x1875759205502848:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788863719.454981:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bda850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:11325:x1875759205502848:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 271us (1466us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788863719.454990:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1788863719.588769:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.588858:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205503104 00000100:00100000:0.0:1788863719.588874:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205503104 00000100:00100000:0.0:1788863719.588958:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00100000:0.0:1788863719.588971:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:10849:x1875759205503104:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863719.589157:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863719.589187:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187f9f expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.589426:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.589445:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.589456:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.589501:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.589518:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 24 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863719.589561:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226558080:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863719.589922:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788863719.598702:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863719.598894:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863719.600354:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205503232 00000100:00100000:1.0:1788863719.600370:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205503232 00010000:00010000:1.0:1788863719.600430:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 25 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863719.600478:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:1.0:1788863719.600489:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:2409:x1875759205503232:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863719.600505:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863719.600512:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 25 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.600528:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 25 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.600551:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:1.0:1788863719.600556:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.600565:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.600573:0:10355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.600612:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863719.600819:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:2409:x1875759205503232:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 331us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863719.600827:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00010000:00010000:3.0:1788863719.603384:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b693e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f98 expref: 24 pid: 6537 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863719.603427:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226558080:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863719.603468:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.603481:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.603488:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863719.603547:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788863719.604400:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b693f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 25 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.604430:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863719.604441:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:3.0:1788863719.604444:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788863719.604453:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d91200, rc 0) 00000100:00100000:3.0:1788863719.604658:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:10849:x1875759205503104:12345-192.168.204.35@tcp:101:bash.0 Request processed in 15687us (16003us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788863719.604671:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00100000:2.0:1788863719.607228:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.607690:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205503360 00000100:00100000:0.0:1788863719.607709:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205503360 00000100:00100000:0.0:1788863719.607801:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:0.0:1788863719.607814:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:10849:x1875759205503360:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863719.607849:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863719.607882:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b6940e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fa6 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.607934:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650115400/0xf569beb9d4b69415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.607954:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650115400/0xf569beb9d4b69415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.607970:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650115400/0xf569beb9d4b69415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.608432:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b6940e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fa6 expref: 26 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.608455:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650115400/0xf569beb9d4b69415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fa6 expref: 25 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.608467:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:0.0:1788863719.608479:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863719.608484:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650115400, rc 0) 00000100:00100000:0.0:1788863719.608674:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:10849:x1875759205503360:12345-192.168.204.35@tcp:101:bash.0 Request processed in 861us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.608683:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:2.0:1788863719.612536:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.612622:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205503616 00000100:00100000:0.0:1788863719.612639:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205503616 00000100:00100000:0.0:1788863719.612727:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 100 00000100:00100000:0.0:1788863719.612740:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:10849:x1875759205503616:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:0.0:1788863719.613062:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.613108:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.613124:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863719.613179:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788863719.613209:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002832f10e reply state 000000006e70235b transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.613224:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.613232:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:0.0:1788863719.613235:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863719.613241:0:6538:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788863719.613365:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788863719.613509:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:10849:x1875759205503616:12345-192.168.204.35@tcp:36:bash.0 Request processed in 770us (987us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788863719.613528:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 100 00000020:00080000:0.0:1788863719.613535:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788863719.620000:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.620503:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205503744 00000100:00100000:0.0:1788863719.620521:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205503744 00000100:00100000:0.0:1788863719.620665:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 101 00000100:00100000:0.0:1788863719.620679:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:10849:x1875759205503744:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863719.620720:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863719.620749:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69423 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fad expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.620830:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69423 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fad expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.620849:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69423 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fad expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.620871:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:0.0:1788863719.620876:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863719.620881:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114a00, rc 0) 00000100:00100000:0.0:1788863719.620978:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:10849:x1875759205503744:12345-192.168.204.35@tcp:101:bash.0 Request processed in 302us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.620986:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 101 00000100:00100000:2.0:1788863719.623730:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.623828:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205503872 00000100:00100000:0.0:1788863719.623843:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205503872 00000100:00100000:0.0:1788863719.623920:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:0.0:1788863719.623932:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:10849:x1875759205503872:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863719.623977:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863719.624005:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fb4 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863719.624036:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fe4e5, atime: 0x6a9fe4e3, ctime: 0x6a9fe4e5, blocks: 0x8 00010000:00010000:0.0:1788863719.624069:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1788863719.624699:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863719.624716:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.624743:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.624761:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114c00, rc 0) 00000100:00100000:0.0:1788863719.624894:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:10849:x1875759205503872:12345-192.168.204.35@tcp:101:bash.0 Request processed in 964us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.624903:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:3.0:1788863719.631959:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.632047:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205504000 00000100:00100000:0.0:1788863719.632062:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205504000 00002000:00010000:0.0:1788863719.632168:0:8456:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788863719.632174:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e54420b800 with x1875759205504000 ext(0->18446744073709551615) 00002000:00010000:0.0:1788863719.632190:0:8456:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e54420b800. 00000100:00100000:0.0:1788863719.632228:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1788863719.632239:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205504000:12345-192.168.204.35@tcp:10:bash.0 00002000:00010000:0.0:1788863719.632640:0:8456:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788863719.632656:0:8456:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788863717 -> 1788863719 00002000:00010000:0.0:1788863719.632659:0:8456:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788863715 -> 1788863715 00002000:00010000:0.0:1788863719.632661:0:8456:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788863717 -> 1788863719 00002000:00010000:0.0:1788863719.632664:0:8456:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788863719.632746:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205504000:12345-192.168.204.35@tcp:10:bash.0 Request processed in 506us (801us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788863719.632756:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00002000:00010000:0.0:1788863719.632761:0:8456:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788863719.632764:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e54420b800 with x1875759205504000 ext(0->18446744073709551615) 00002000:00010000:0.0:1788863719.632769:0:8456:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e54420b800. 00000100:00100000:3.0:1788863719.789705:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.792615:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205504128 00000100:00100000:0.0:1788863719.792637:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205504128 00000100:00100000:0.0:1788863719.793173:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 102 00000100:00100000:0.0:1788863719.793188:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:11339:x1875759205504128:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:0.0:1788863719.793818:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.793848:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.793864:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.793882:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.793890:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.793897:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794314:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794325:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794333:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863719.794402:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794419:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794428:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794435:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794443:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863719.794449:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794457:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794473:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863719.794476:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863719.794482:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794497:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794514:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794520:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794526:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794531:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863719.794533:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794539:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794546:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e651fef600) 00010000:00010000:0.0:1788863719.794549:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863719.794552:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794558:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69438 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794575:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794581:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794593:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794598:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259be00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863719.794601:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794607:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794615:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:0.0:1788863719.794618:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863719.794620:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.794626:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b6943f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863719.794768:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:11339:x1875759205504128:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 1578us (5078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.794779:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 102 00000100:00100000:1.0:1788863719.865530:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.865951:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205504384 00000100:00100000:0.0:1788863719.865965:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205504384 00000100:00100000:0.0:1788863719.866036:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 103 00000100:00100000:0.0:1788863719.866044:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:11342:x1875759205504384:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863719.866065:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863719.866134:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fbb expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.866236:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.866263:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.866275:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.866295:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.866303:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.866309:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866691:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b6945b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866712:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b6945b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866724:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b6945b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863719.866738:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788863719.866845:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866866:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866873:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866880:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863719.866885:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866893:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866907:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788863719.866910:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863719.866916:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866922:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6944d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866938:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866945:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866950:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866955:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863719.866966:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866973:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.866994:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e651fef600) 00010000:00010000:2.0:1788863719.866997:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863719.867001:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.867007:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.867067:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fbb expref: 33 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.867130:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b6945b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fbb expref: 32 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863719.867138:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:2.0:1788863719.867207:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788863719.867211:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99c00, rc 0) 00000100:00100000:2.0:1788863719.867500:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:11342:x1875759205504384:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1454us (1983us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788863719.867510:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 103 00000100:00100000:2.0:1788863719.872249:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863719.873461:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205504512 00000100:00100000:0.0:1788863719.873477:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205504512 00000100:00100000:0.0:1788863719.873635:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 104 00000100:00100000:0.0:1788863719.873647:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:11342:x1875759205504512:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:0.0:1788863719.873717:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.873736:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 32 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.873745:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.873798:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 32 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.873825:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 32 pid: 6536 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863719.873840:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226558208:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863719.874034:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863719.880557:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863719.880645:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226558208:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863719.880676:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863719.881065:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205504768 00000100:00100000:0.0:1788863719.881091:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205504768 00000100:00100000:0.0:1788863719.881155:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:0.0:1788863719.881165:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:6185:x1875759205504768:12345-192.168.204.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788863719.884064:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:6185:x1875759205504768:12345-192.168.204.35@tcp:35:ldlm_bl.0 Request processed in 2891us (3508us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788863719.884091:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:3.0:1788863719.904206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863719.904646:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205504896 00000100:00100000:1.0:1788863719.904658:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205504896 00010000:00010000:1.0:1788863719.904701:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 34 pid: 6536 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863719.904749:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:1.0:1788863719.904758:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:2408:x1875759205504896:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863719.904786:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863719.904793:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 34 pid: 6536 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.904806:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 34 pid: 6536 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.904832:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69400 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f9f expref: 34 pid: 6536 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.904860:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:1.0:1788863719.904866:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.904897:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.904905:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863719.904941:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863719.905136:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:2408:x1875759205504896:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 378us (938us total) trans 0 rc 0/0 00010000:00010000:0.0:1788863719.905239:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905247:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905297:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905305:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905312:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905325:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863719.905330:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905338:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905348:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:0.0:1788863719.905351:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863719.905354:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863719.905359:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863719.905402:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:11342:x1875759205504512:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 31757us (33179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.905411:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 104 00000100:00100000:1.0:1788863719.905465:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:2.0:1788863719.912716:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863719.913635:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205505152 00000100:00100000:1.0:1788863719.913652:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205505152 00000100:00100000:1.0:1788863719.913981:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:1.0:1788863719.913992:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:11342:x1875759205505152:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863719.914670:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:11342:x1875759205505152:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 676us (1960us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788863719.914689:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:0.0:1788863719.917539:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226558720:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.917618:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863719.917654:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226559232:0@lo:400:kworker.0 00000100:00100000:3.0:1788863719.918106:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226558592:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.918404:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226558336:0@lo:400:kworker.0 00000100:00100000:1.0:1788863719.918689:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226558464:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.922525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863719.922595:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226558848:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.923023:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863719.923054:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226559360:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.923416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863719.923446:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226559744:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.923495:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863719.923552:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226558720 00000100:00100000:0.0:1788863719.923561:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226558720 00000100:00100000:3.0:1788863719.923594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863719.923608:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788863719.923618:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226558720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863719.923633:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226559104:0@lo:400:kworker.0 00000100:00100000:3.0:1788863719.923657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863719.923675:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226559616:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.923692:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226558720:12345-0@lo:400:kworker.0 Request processed in 76us (6074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.923696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863719.923701:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788863719.923724:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226559104 00000100:00100000:3.0:1788863719.923728:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226559104 00000100:00100000:0.0:1788863719.923728:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226559616 00000100:00100000:0.0:1788863719.923730:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226559616 00000100:00100000:1.0:1788863719.923804:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863719.923829:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226558976:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.924073:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226558464 00000100:00100000:0.0:1788863719.924110:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226558464 00000100:00100000:0.0:1788863719.924131:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788863719.924137:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226559616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.924188:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226559616:12345-0@lo:400:kworker.0 Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.924194:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788863719.924206:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788863719.924212:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226558464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.924240:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226558464:12345-0@lo:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.924246:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788863719.924284:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226558848 00000100:00100000:0.0:1788863719.924288:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226558848 00000100:00100000:0.0:1788863719.924311:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226558592 00000100:00100000:0.0:1788863719.924314:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226558592 00000100:00100000:0.0:1788863719.924328:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788863719.924335:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226558848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.924368:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226558848:12345-0@lo:400:kworker.0 Request processed in 34us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.924374:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788863719.924386:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788863719.924398:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226558592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.924428:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226558592:12345-0@lo:400:kworker.0 Request processed in 30us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.924433:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1788863719.924450:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863719.924479:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788863719.924483:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226558592:0@lo:400:kworker.0 00000100:00100000:3.0:1788863719.924486:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226559104:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788863719.924498:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5441c0a80 x1875759226559616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863719.924509:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226559616:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.924548:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226558720:0@lo:400:kworker.0 00000100:00100000:3.0:1788863719.924590:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226559104:12345-0@lo:400:kworker.0 Request processed in 105us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.924597:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00080000:3.0:1788863719.924742:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5441c3100 x1875759226559104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863719.924751:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226559104:0@lo:400:kworker.0 00000100:00100000:1.0:1788863719.925196:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863719.925234:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226559488:0@lo:400:kworker.0 00000100:00100000:1.0:1788863719.925278:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863719.925307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226558464:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.925462:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226558976 00000100:00100000:0.0:1788863719.925467:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226558976 00000100:00100000:0.0:1788863719.925504:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226559488 00000100:00100000:0.0:1788863719.925508:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226559488 00000100:00100000:0.0:1788863719.925527:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788863719.925534:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226558976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.925576:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226558976:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.925582:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788863719.925597:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788863719.925603:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226559488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.925631:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226559488:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863719.925636:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788863719.925664:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226558976:0@lo:400:kworker.0 00000100:00100000:0.0:1788863719.925686:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226559488:0@lo:400:kworker.0 00000100:00100000:3.0:1788863719.926192:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00080000:1.0:1788863719.926407:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863719.926463:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863719.926496:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226558336 00000100:00100000:2.0:1788863719.926502:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226558336 00000100:00100000:2.0:1788863719.926536:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205505280 00000100:00100000:2.0:1788863719.926540:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205505280 00000100:00100000:2.0:1788863719.926556:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788863719.926563:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226558336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.926604:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226558336:12345-0@lo:400:kworker.0 Request processed in 42us (4086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863719.926612:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788863719.926638:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 385 00000100:00100000:2.0:1788863719.926645:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205505280:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863719.926823:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863719.927394:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205505280:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 40us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863719.927404:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 385 00000100:00100000:3.0:1788863719.927430:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863719.927470:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863719.927744:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863719.927763:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205505792 00000100:00100000:3.0:1788863719.927768:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205505792 00000100:00100000:3.0:1788863719.927803:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205505408 00000100:00100000:3.0:1788863719.927805:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205505408 00000100:00100000:3.0:1788863719.927818:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205505920 00000100:00100000:3.0:1788863719.927820:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205505920 00000100:00100000:3.0:1788863719.927835:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 310 00000100:00100000:3.0:1788863719.927842:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205505792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863719.927892:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205505792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 49us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.927897:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 310 00000100:00100000:3.0:1788863719.927911:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 311 00000100:00100000:3.0:1788863719.927917:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205505408:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863719.927953:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205505408:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 36us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.927959:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 311 00000100:00100000:3.0:1788863719.927970:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 312 00000100:00100000:3.0:1788863719.927976:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205505920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863719.927998:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205505920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.928004:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 312 00000100:00080000:3.0:1788863719.928020:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863719.928023:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863719.928309:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226559232 00000100:00100000:2.0:1788863719.928315:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226559232 00000100:00100000:3.0:1788863719.928337:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226559744 00000100:00100000:2.0:1788863719.928337:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205505536 00000100:00100000:2.0:1788863719.928340:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205505536 00000100:00100000:3.0:1788863719.928341:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226559744 00000100:00100000:2.0:1788863719.928352:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205505664 00000100:00100000:2.0:1788863719.928362:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205505664 00000100:00100000:3.0:1788863719.928363:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788863719.928368:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226559232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.928379:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00100000:2.0:1788863719.928384:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205505536:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863719.928410:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205505536:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.928412:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226559232:12345-0@lo:400:kworker.0 Request processed in 44us (4997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863719.928417:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00100000:3.0:1788863719.928428:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788863719.928435:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788863719.928439:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 113 00000100:00100000:2.0:1788863719.928441:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226559744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863719.928444:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205505664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863719.928463:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205505664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 19us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863719.928469:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 113 00000100:00100000:2.0:1788863719.928476:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226559744:12345-0@lo:400:kworker.0 Request processed in 36us (4982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863719.928482:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788863719.928483:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863719.928502:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863719.928534:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226559872:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.928562:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863719.928597:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226558336:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.928611:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226558848:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.928636:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226559360 00000100:00100000:2.0:1788863719.928639:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226559360 00000100:00100000:2.0:1788863719.928654:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226559872 00000100:00100000:2.0:1788863719.928657:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226559872 00000100:00100000:2.0:1788863719.928961:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863719.928968:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226559360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.929008:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226559360:12345-0@lo:400:kworker.0 Request processed in 42us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863719.929013:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863719.929033:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788863719.929039:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226559872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.929066:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226559872:12345-0@lo:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863719.929071:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788863719.929334:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863719.929359:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226559360:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.929370:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226559872:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.929419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226559232:0@lo:400:kworker.0 00000100:00100000:2.0:1788863719.929431:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226559744:0@lo:400:kworker.0 00000100:00100000:2.0:1788863720.063495:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.063616:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205506176 00000100:00100000:3.0:1788863720.063631:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205506176 00000100:00100000:3.0:1788863720.063793:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 105 00000100:00100000:3.0:1788863720.063806:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:11353:x1875759205506176:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:3.0:1788863720.063844:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863720.063873:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69470 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fc2 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788863720.064356:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788863720.065889:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.065921:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.065936:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.065958:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.066491:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.066505:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.066905:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.066919:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.066927:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863720.067306:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788863720.067457:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067469:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067478:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067485:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863720.067491:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067501:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067517:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863720.067520:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863720.067526:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067533:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b69477 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067551:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067557:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067576:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067582:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863720.067585:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067593:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067602:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:3.0:1788863720.067604:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863720.067607:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.067613:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6947e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.068361:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69470 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc2 expref: 36 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.068392:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc2 expref: 35 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.068401:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:3.0:1788863720.068403:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863720.068406:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641378a00, rc 0) 00000100:00100000:3.0:1788863720.068517:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:11353:x1875759205506176:12345-192.168.204.35@tcp:101:cat.0 Request processed in 4711us (5041us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788863720.068544:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 105 00000100:00100000:0.0:1788863720.076606:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.076939:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205506432 00000100:00100000:2.0:1788863720.076954:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205506432 00000100:00100000:2.0:1788863720.077040:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:2.0:1788863720.077052:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:11353:x1875759205506432:12345-192.168.204.35@tcp:35:cat.0 00000100:00100000:2.0:1788863720.077616:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:11353:x1875759205506432:12345-192.168.204.35@tcp:35:cat.0 Request processed in 563us (1023us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788863720.077626:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:0.0:1788863720.102659:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.102825:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205506688 00000100:00100000:3.0:1788863720.102840:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205506688 00000100:00100000:3.0:1788863720.102921:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 106 00000100:00100000:3.0:1788863720.102933:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:11354:x1875759205506688:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:3.0:1788863720.103041:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788863720.103121:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69423 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fad expref: 36 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103439:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc2 expref: 35 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103455:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b6945b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fbb expref: 34 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103468:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650115400/0xf569beb9d4b69415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fa6 expref: 33 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103481:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:3.0:1788863720.103487:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863720.103519:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103539:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103551:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103592:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103601:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103609:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.103976:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.104563:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.104575:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863720.105367:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788863720.105384:0:10368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387229306325ns, next at 388229302544ns, rc = 0 00010000:00010000:3.0:1788863720.105464:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.105477:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.105488:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.105495:0:10368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106434:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106441:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106540:0:10368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863720.106582:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106589:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106596:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106603:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863720.106609:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106618:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106637:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:3.0:1788863720.106641:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788863720.106647:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106653:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106694:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106707:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106714:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106720:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641379e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863720.106723:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106729:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106740:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863720.106742:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863720.106746:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106752:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69493 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863720.106768:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d95faba reply state 00000000a8031997 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106783:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.106791:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:3.0:1788863720.106794:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863720.106798:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863720.106947:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:11354:x1875759205506688:12345-192.168.204.35@tcp:36:rm.0 Request processed in 4008us (4294us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788863720.106978:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 106 00010000:00010000:0.0:1788863720.114902:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863720.114928:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.114945:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641379c00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863720.114952:0:9549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.115779:0:9549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.115815:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:0.0:1788863720.115819:0:9549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788863720.115826:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.115834:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b694a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.115865:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863720.115868:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863720.115871:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863720.175718:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863720.175842:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205506944 00000100:00100000:0.0:1788863720.175859:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205506944 00000100:00100000:0.0:1788863720.175952:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 107 00000100:00100000:0.0:1788863720.175978:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:11360:x1875759205506944:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863720.176027:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863720.176107:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b694af lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fc9 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.176618:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.176642:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.176662:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.176675:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.176683:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.176689:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863720.178887:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788863720.180480:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180510:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180527:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180580:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180614:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180621:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180627:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ae00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863720.180631:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180639:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180655:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863720.180658:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863720.180664:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180683:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b694b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863720.180702:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eb0be9f reply state 0000000079ce63c5 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180715:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180721:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:0.0:1788863720.180724:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863720.180728:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788863720.180783:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b694af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 37 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180807:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 36 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.180816:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e651feff00) 00010000:00010000:0.0:1788863720.180818:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863720.180821:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b800, rc 0) 00000100:00100000:0.0:1788863720.180943:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:11360:x1875759205506944:12345-192.168.204.35@tcp:101:bash.0 Request processed in 4978us (5241us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788863720.180955:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 107 00000100:00100000:1.0:1788863720.190492:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.190611:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205507072 00000100:00100000:2.0:1788863720.190625:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205507072 00000100:00100000:2.0:1788863720.190709:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:2.0:1788863720.190722:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205507072:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788863720.190749:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863720.190796:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fd0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863720.190834:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863720.190865:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788863720.190870:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863720.190883:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.190907:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.190924:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:2.0:1788863720.191495:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205507072:12345-192.168.204.35@tcp:101:bash.0 Request processed in 772us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863720.191505:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:3.0:1788863720.197512:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863720.197857:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205507200 00000100:00100000:1.0:1788863720.197871:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205507200 00000100:00100000:1.0:1788863720.197954:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:1.0:1788863720.197966:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:11360:x1875759205507200:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863720.197993:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863720.198027:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fd7 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.198067:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.198118:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863720.198123:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863720.198130:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.198176:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.198194:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 9 pid: 8451 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863720.198772:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1875759226560000:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863720.198960:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863720.205835:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.206109:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205507328 00000100:00100000:2.0:1788863720.206122:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205507328 00010000:00010000:2.0:1788863720.206192:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 10 pid: 8451 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863720.206273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:2.0:1788863720.206286:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2408:x1875759205507328:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863720.206307:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863720.206338:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 10 pid: 8451 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.206389:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 10 pid: 8451 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.206428:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863720.206433:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863720.206445:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.206455:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.206505:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863720.206524:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6524:1875759226560128:192.168.204.35@tcp:105: 00000100:00100000:2.0:1788863720.206661:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d540600 going to sleep for 11 seconds 00010000:00010000:1.0:1788863720.207851:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b694d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd0 expref: 10 pid: 8451 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863720.207904:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1875759226560000:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863720.207943:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.207959:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ea00, rc 0) 00000100:00100000:1.0:1788863720.208058:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:11360:x1875759205507200:12345-192.168.204.35@tcp:101:bash.0 Request processed in 10092us (10560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863720.208069:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:3.0:1788863720.214370:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.214631:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6524:1875759226560128:192.168.204.35@tcp:105: 00010000:00010000:2.0:1788863720.214682:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863720.214770:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205507328:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 8485us (8950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863720.214784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788863720.214946:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205507584 00000100:00100000:0.0:1788863720.214955:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205507584 00000100:00100000:0.0:1788863720.215027:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:0.0:1788863720.215039:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:11360:x1875759205507584:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:0.0:1788863720.215725:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:11360:x1875759205507584:12345-192.168.204.35@tcp:35:bash.0 Request processed in 685us (1370us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788863720.215734:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788863720.402035:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.402447:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205507712 00000100:00100000:3.0:1788863720.402461:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205507712 00000100:00100000:3.0:1788863720.402578:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 108 00000100:00100000:3.0:1788863720.402592:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:11376:x1875759205507712:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863720.402626:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863720.402654:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b694e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fde expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.402781:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.402802:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.402828:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863720.402892:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788863720.402897:0:12972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863720.402932:0:12972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.402965:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b694e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fde expref: 40 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.403007:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fde expref: 39 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.403016:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788863720.403019:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863720.403023:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641378200, rc 0) 00000100:00100000:3.0:1788863720.403455:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:11376:x1875759205507712:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 865us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863720.403464:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 108 00000100:00100000:3.0:1788863720.414476:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863720.414805:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205507968 00000100:00100000:0.0:1788863720.414871:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205507968 00000100:00100000:2.0:1788863720.415571:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 109 00000100:00100000:2.0:1788863720.415590:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:11376:x1875759205507968:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863720.415637:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863720.415667:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b694ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fe5 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.415831:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b694f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.415850:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b694f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.415865:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b694f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863720.415879:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788863720.416379:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b694ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fe5 expref: 42 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.416405:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b694f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fe5 expref: 41 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.416415:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e651feff00) 00010000:00010000:2.0:1788863720.416418:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863720.416423:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99400, rc 0) 00000100:00100000:2.0:1788863720.416576:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:11376:x1875759205507968:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 994us (2115us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788863720.416585:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 109 00000100:00100000:0.0:1788863720.422971:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863720.423361:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205508096 00000100:00100000:1.0:1788863720.423376:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205508096 00000100:00100000:1.0:1788863720.423580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788863720.423594:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:2410:x1875759205508096:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863720.423617:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863720.423653:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b694f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fe5 expref: 41 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.423690:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e651feff00) 00010000:00010000:1.0:1788863720.423697:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863720.423775:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:2410:x1875759205508096:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 185us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863720.423784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:2.0:1788863720.429184:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863720.429217:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226560256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863720.430305:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863720.430416:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205508352 00000100:00100000:1.0:1788863720.430429:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205508352 00000100:00100000:1.0:1788863720.430500:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 110 00000100:00100000:1.0:1788863720.430531:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:11376:x1875759205508352:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863720.430563:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863720.430590:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187fec expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863720.430815:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863720.430834:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226560384:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863720.430947:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b6950a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.430969:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b6950a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.430983:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b6950a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863720.430997:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788863720.431180:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fec expref: 43 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.431205:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b6950a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fec expref: 42 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.431228:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e651feff00) 00010000:00010000:1.0:1788863720.431231:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863720.431235:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f400, rc 0) 00000100:00100000:2.0:1788863720.436233:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863720.436363:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.436400:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.436427:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205508608 00000100:00100000:2.0:1788863720.436427:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226560256 00000100:00100000:3.0:1788863720.436437:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205508608 00000100:00100000:2.0:1788863720.436438:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226560256 00000100:00100000:3.0:1788863720.436494:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:2.0:1788863720.436494:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788863720.436505:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205508608:12345-192.168.204.35@tcp:16:kworker.0 00000100:00100000:2.0:1788863720.436505:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226560256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863720.436547:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788863720.436634:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205508608:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 131us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863720.436642:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:2.0:1788863720.438723:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226560256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2208us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863720.438741:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788863720.438788:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+42:11376:x1875759205508352:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 8254us (8569us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788863720.438798:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 110 00000100:00100000:2.0:1788863720.438847:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226560256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863720.438910:0:8458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205508480 00000100:00100000:1.0:1788863720.438918:0:8458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205508480 00002000:00100000:1.0:1788863720.438988:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff89e67f898380 x1875759205508480/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:706/0 lens 504/0 e 0 to 0 dl 1788863731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788863720.438999:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e67f898380 with x1875759205508480 ext(0->8) 00002000:00010000:1.0:1788863720.439005:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e67f898380 00000100:00100000:1.0:1788863720.439050:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:1.0:1788863720.439059:0:8458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205508480:12345-192.168.204.35@tcp:4:bash.0 00000100:00100000:1.0:1788863720.444129:0:8458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2409:x1875759205508480:12345-192.168.204.35@tcp:4:bash.0 Request processed in 5056us (7754us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788863720.444145:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00002000:00100000:1.0:1788863720.444158:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff89e67f898380 x1875759205508480/t4294967303(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:706/0 lens 504/448 e 0 to 0 dl 1788863731 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788863720.444168:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e67f898380 with x1875759205508480 ext(0->8) 00002000:00010000:1.0:1788863720.444174:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e67f898380 00000100:00100000:0.0:1788863720.451434:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863720.451632:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226560384 00000100:00100000:2.0:1788863720.451645:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226560384 00000100:00100000:2.0:1788863720.451728:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788863720.451740:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226560384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863720.451774:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863720.451842:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226560384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863720.451850:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788863720.452447:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226560384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863720.459754:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.461700:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205508736 00000100:00100000:2.0:1788863720.461721:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205508736 00000100:00100000:2.0:1788863720.461876:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:2.0:1788863720.461889:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2408:x1875759205508736:12345-192.168.204.35@tcp:1:lfs.0 00010000:00010000:2.0:1788863720.461953:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.462006:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.462041:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863720.462046:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863720.462052:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.462133:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.462149:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 10 pid: 8452 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863720.462167:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1875759226560512:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863720.462385:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077840 going to sleep for 11 seconds 00000100:00100000:2.0:1788863720.468404:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1875759226560512:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863720.468450:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863720.469152:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.469401:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205508864 00000100:00100000:2.0:1788863720.469416:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205508864 00010000:00010000:2.0:1788863720.469469:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 11 pid: 8452 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863720.469517:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788863720.469527:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2408:x1875759205508864:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863720.469569:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788863720.469593:0:10356:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788863720.469596:0:10356:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788863720 00002000:00010000:2.0:1788863720.469599:0:10356:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788863720 00002000:00010000:2.0:1788863720.469602:0:10356:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788863720.469609:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 11 pid: 8452 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.469624:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 11 pid: 8452 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.469653:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a542913/0xf569beb9d4b694d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fd7 expref: 11 pid: 8452 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.469685:0:10356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863720.469691:0:10356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863720.469698:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.469709:0:10356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.469740:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863720.469826:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2408:x1875759205508864:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 300us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863720.469834:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00010000:00010000:0.0:1788863720.470790:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470821:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470858:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470869:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470880:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470889:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863720.470896:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470907:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470926:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.470935:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b69518 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863720.471067:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205508736:12345-192.168.204.35@tcp:1:lfs.0 Request processed in 9176us (11331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863720.471109:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:2.0:1788863720.477541:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863720.477923:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205509120 00000100:00100000:1.0:1788863720.477938:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205509120 00000100:00100000:1.0:1788863720.478026:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:1.0:1788863720.478038:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+42:11376:x1875759205509120:12345-192.168.204.35@tcp:35:lfs.0 00000004:00010000:1.0:1788863720.478176:0:6539:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b6950a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fec expref: 42 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863720.478681:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788863720.478722:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788863720.479655:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788863720.479933:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.480047:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 46 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.480058:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.480161:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 46 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.480181:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 46 pid: 6536 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863720.480200:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875759226560640:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863720.480610:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863720.486536:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.486701:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875759226560640:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863720.486762:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863720.487034:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205509248 00000100:00100000:3.0:1788863720.487044:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205509248 00010000:00010000:3.0:1788863720.487327:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 47 pid: 6536 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863720.487401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788863720.487412:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+47:2409:x1875759205509248:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863720.487433:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863720.487441:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 47 pid: 6536 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.487454:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 47 pid: 6536 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.487482:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b694c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fc9 expref: 47 pid: 6536 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.487502:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e651feff00) 00010000:00010000:3.0:1788863720.487508:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.487519:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.487528:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.487607:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863720.487699:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:2409:x1875759205509248:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 287us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863720.487706:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00010000:00010000:2.0:1788863720.488985:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.489011:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863720.489354:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788863720.489519:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788863720.489975:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226560768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788863720.490059:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863720.490964:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863720.493635:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226560768 00000100:00100000:0.0:1788863720.493652:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226560768 00000100:00100000:0.0:1788863720.493732:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788863720.493743:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6539:x1875759226560768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788863720.494366:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6539:x1875759226560768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 624us (4306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863720.494376:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788863720.494477:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226560768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788863720.494869:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788863720.494956:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226560896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788863720.494997:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863720.495029:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d540540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863720.497256:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226560896 00000100:00100000:3.0:1788863720.497288:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226560896 00000100:00100000:3.0:1788863720.497347:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788863720.497357:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6539:x1875759226560896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788863720.497577:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6539:x1875759226560896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 220us (2578us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788863720.497590:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788863720.498478:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875759226560896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788863720.498558:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788863720.498609:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.498620:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.498641:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.498647:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863720.498652:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.498660:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.498676:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e651feff00) 00010000:00010000:2.0:1788863720.498680:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788863720.498685:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863720.498692:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6951f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863720.498830:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788863720.498891:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788863720.498903:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387622826079ns, next at 388622823246ns, rc = 0 00000001:00080000:2.0:1788863720.498909:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788863720.498932:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e651feff00) 00010000:00010000:2.0:1788863720.498936:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788863720.498943:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b6950a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fec expref: 50 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863720.499043:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+49:11376:x1875759205509120:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 21007us (21517us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788863720.499095:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000020:00080000:2.0:1788863720.499102:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000001:00080000:0.0:1788863720.503679:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788863720.504371:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788863720.509100:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863720.512357:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205509376 00000100:00100000:0.0:1788863720.512377:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205509376 00000100:00100000:0.0:1788863720.512462:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00100000:0.0:1788863720.512474:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+49:11376:x1875759205509376:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863720.512504:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863720.512532:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69526 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ff3 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.512596:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69526 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ff3 expref: 50 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.512613:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69526 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ff3 expref: 50 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.512659:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863720.512663:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863720.512667:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b400, rc 0) 00000100:00100000:0.0:1788863720.512990:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+50:11376:x1875759205509376:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 516us (3932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863720.512998:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00100000:0.0:1788863720.521573:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.521690:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205509632 00000100:00100000:2.0:1788863720.521702:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205509632 00000100:00100000:0.0:1788863720.521888:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:0.0:1788863720.521901:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+50:11376:x1875759205509632:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863720.522973:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+51:11376:x1875759205509632:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 1069us (1404us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788863720.522984:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00010000:00010000:2.0:1788863720.620308:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863720.633920:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.634005:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205509760 00000100:00100000:3.0:1788863720.634016:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205509760 00000100:00100000:1.0:1788863720.634129:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 112 00000100:00100000:1.0:1788863720.634142:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+51:11386:x1875759205509760:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:1.0:1788863720.634224:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634257:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634289:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634305:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634314:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634320:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634455:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634464:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.634472:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863720.636294:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636320:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636327:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636335:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636362:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863720.636367:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636374:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636390:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863720.636394:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863720.636399:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636406:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b6952d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636428:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636435:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636442:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636448:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863720.636451:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636457:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636478:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:1.0:1788863720.636481:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863720.636485:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636491:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69534 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636502:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636508:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636514:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636520:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863720.636523:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636529:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636536:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863720.636538:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863720.636541:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.636547:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6953b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863720.636686:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+51:11386:x1875759205509760:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 2542us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863720.636697:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 112 00000100:00100000:3.0:1788863720.743874:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863720.745491:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205510016 00000100:00100000:1.0:1788863720.745511:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205510016 00000100:00100000:1.0:1788863720.745615:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 113 00000100:00100000:1.0:1788863720.745627:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+51:11389:x1875759205510016:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863720.745656:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863720.745681:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69542 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25187ffa expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.745774:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.745791:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.745805:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.745827:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.745835:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.745842:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.746838:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69557 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.746855:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.746866:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863720.746879:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788863720.747031:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747042:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747050:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747065:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863720.747112:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747121:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747146:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863720.747162:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863720.747168:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747201:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69549 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747218:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747224:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747229:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747244:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863720.747248:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.747254:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.749612:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:1.0:1788863720.749633:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863720.749648:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.749660:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69550 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.749765:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69542 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ffa expref: 54 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.749785:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ffa expref: 53 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.751529:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863720.751533:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863720.751538:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e800, rc 0) 00000100:00100000:1.0:1788863720.751655:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:11389:x1875759205510016:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 6024us (7790us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788863720.751666:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 113 00000100:00100000:0.0:1788863720.761149:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.762615:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205510144 00000100:00100000:3.0:1788863720.762634:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205510144 00000100:00100000:3.0:1788863720.762731:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:3.0:1788863720.762744:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:11389:x1875759205510144:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:3.0:1788863720.764765:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.764795:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765039:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765494:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765504:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765512:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765544:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863720.765550:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765558:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765574:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863720.765577:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863720.765582:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.765589:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863720.765720:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:11389:x1875759205510144:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 2973us (4584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863720.765732:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:2.0:1788863720.774576:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863720.774789:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205510400 00000100:00100000:0.0:1788863720.774803:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205510400 00000100:00100000:0.0:1788863720.774896:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:0.0:1788863720.774908:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:11389:x1875759205510400:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788863720.775666:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:11389:x1875759205510400:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 757us (1102us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788863720.775677:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:1.0:1788863720.901740:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863720.901928:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205510656 00000100:00100000:0.0:1788863720.901943:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205510656 00000100:00100000:0.0:1788863720.902029:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 115 00000100:00100000:0.0:1788863720.902042:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:11399:x1875759205510656:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863720.902116:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863720.902134:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788863720.902172:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b694e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fde expref: 54 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.902470:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863720.902478:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863720.902496:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b6956c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188001 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.902677:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69573 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.902712:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.902726:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863720.902738:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788863720.903465:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b6956c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188001 expref: 56 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.903490:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69573 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188001 expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863720.903500:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863720.903504:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863720.903506:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a400, rc 0) 00000100:00100000:0.0:1788863720.903607:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:11399:x1875759205510656:12345-192.168.204.35@tcp:101:bash.0 Request processed in 1567us (1883us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788863720.903617:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 115 00000100:00100000:2.0:1788863720.911541:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863720.911605:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.911772:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205510912 00000100:00100000:3.0:1788863720.911786:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205510912 00000100:00100000:3.0:1788863720.911871:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:3.0:1788863720.911883:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:11399:x1875759205510912:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863720.912332:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863720.912361:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69581 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188008 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.912410:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.912453:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.912469:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.912623:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b69581 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 57 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.912649:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 56 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863720.913121:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205510784 00000100:00100000:1.0:1788863720.913143:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205510784 00000100:00100000:1.0:1788863720.913403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1788863720.913415:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+57:2410:x1875759205510784:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863720.913430:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863720.913451:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69573 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188001 expref: 57 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.913470:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863720.913477:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863720.913573:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+56:2410:x1875759205510784:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 161us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863720.913582:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00010000:00010000:3.0:1788863720.913680:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863720.913683:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863720.913685:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641379e00, rc 0) 00000100:00100000:3.0:1788863720.913727:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:11399:x1875759205510912:12345-192.168.204.35@tcp:101:bash.0 Request processed in 1847us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863720.913735:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:2.0:1788863720.922794:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863720.923003:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205511168 00000100:00100000:3.0:1788863720.923017:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205511168 00000100:00100000:3.0:1788863720.923143:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:3.0:1788863720.923157:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:11399:x1875759205511168:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:3.0:1788863720.923265:0:12972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863720.923304:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69557 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ffa expref: 55 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.923330:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863720.923358:0:12972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863720.923597:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.923616:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.923627:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863720.923700:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788863720.923731:0:12972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000052e43cf reply state 0000000010054135 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.923746:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863720.923752:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863720.923754:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863720.923757:0:12972:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863720.923889:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+57:11399:x1875759205511168:12345-192.168.204.35@tcp:36:bash.0 Request processed in 735us (1112us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788863720.923898:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 117 00000020:00080000:3.0:1788863720.923906:0:12972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788863720.931946:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863720.932808:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205511296 00000100:00100000:1.0:1788863720.932836:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205511296 00000100:00100000:1.0:1788863720.933013:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:1.0:1788863720.933026:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+57:11399:x1875759205511296:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863720.933061:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863720.934419:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69596 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518800f expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.934572:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.934595:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.934611:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863720.934667:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788863720.934674:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863720.934703:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.934745:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 59 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.934769:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 58 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863720.934779:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863720.934782:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863720.934786:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863720.934889:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+58:11399:x1875759205511296:12345-192.168.204.35@tcp:101:bash.0 Request processed in 1865us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863720.934908:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:2.0:1788863720.940396:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863720.940432:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226561024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863720.940522:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863720.940572:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863720.940616:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226561152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863720.940705:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863720.940869:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226561024 00000100:00100000:3.0:1788863720.940880:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226561024 00000100:00100000:3.0:1788863720.940946:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226561152 00000100:00100000:3.0:1788863720.940956:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226561152 00000100:00100000:3.0:1788863720.940977:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788863720.940986:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226561024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863720.941032:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788863720.941132:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226561024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863720.941140:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788863720.941161:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788863720.941167:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226561152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863720.941187:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788863720.941220:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226561152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863720.941226:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788863720.941432:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226561152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863720.941652:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226561024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863720.955390:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863720.959859:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205511552 00000100:00100000:0.0:1788863720.959878:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205511552 00000100:00100000:0.0:1788863720.959954:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:0.0:1788863720.959963:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+58:11399:x1875759205511552:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:0.0:1788863720.960732:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+59:11399:x1875759205511552:12345-192.168.204.35@tcp:35:bash.0 Request processed in 764us (5348us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788863720.960754:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:3.0:1788863721.072206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863721.072445:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205511680 00000100:00100000:1.0:1788863721.072455:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205511680 00000100:00100000:1.0:1788863721.072526:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:1.0:1788863721.072535:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+59:11404:x1875759205511680:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863721.072561:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863721.072582:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b695a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188016 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.073397:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b695ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.073417:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b695ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.073431:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b695ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863721.073519:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788863721.073523:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863721.073543:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b695ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.073571:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b695a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188016 expref: 61 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.073592:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b695ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188016 expref: 60 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.073620:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788863721.073622:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863721.073626:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f000, rc 0) 00000100:00100000:1.0:1788863721.077703:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:11404:x1875759205511680:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 5155us (5492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863721.077717:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:1.0:1788863721.082113:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863721.082259:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205511808 00000100:00100000:0.0:1788863721.082270:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205511808 00000100:00100000:0.0:1788863721.082334:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:0.0:1788863721.082345:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:11404:x1875759205511808:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863721.082367:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863721.082389:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b695b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518801d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082458:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082474:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082485:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082496:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082504:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082529:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082604:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b695c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082614:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b695c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082620:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b695c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863721.082683:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788863721.082688:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863721.082705:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b695c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082719:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b695c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082728:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082734:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082741:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082754:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863721.082759:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082775:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082789:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863721.082792:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863721.082797:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082803:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082817:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082823:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082830:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082836:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863721.082839:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082845:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082853:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:0.0:1788863721.082855:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863721.082859:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082876:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082904:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b695b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518801d expref: 62 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082919:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b695c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518801d expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.082926:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863721.082929:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863721.082931:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259ac00, rc 0) 00000100:00100000:0.0:1788863721.083001:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11404:x1875759205511808:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 659us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863721.083009:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:2.0:1788863721.090471:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863721.090606:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205511936 00000100:00100000:3.0:1788863721.090619:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205511936 00000100:00100000:3.0:1788863721.093455:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:3.0:1788863721.093482:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:2408:x1875759205511936:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863721.093498:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863721.093526:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b695c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518801d expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.093547:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863721.093551:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863721.093631:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:2408:x1875759205511936:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 163us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863721.093638:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:3.0:1788863721.095194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863721.095322:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205512192 00000100:00100000:1.0:1788863721.095331:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205512192 00000100:00100000:1.0:1788863721.095394:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:1.0:1788863721.095404:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:11404:x1875759205512192:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863721.095425:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863721.095446:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b695ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188024 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.095560:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.095576:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 61 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.095586:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.095623:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 61 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.095666:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 61 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863721.095681:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226561280:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863721.095782:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788863721.100213:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863721.100426:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226561280:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863721.100453:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863721.100875:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205512320 00000100:00100000:3.0:1788863721.100884:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205512320 00010000:00010000:3.0:1788863721.100927:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 62 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863721.101264:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788863721.101276:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:2409:x1875759205512320:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863721.101292:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863721.101300:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 62 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.101313:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 62 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.101335:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6959d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518800f expref: 62 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.101350:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863721.101355:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.101365:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.101372:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.101399:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863721.101458:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:2409:x1875759205512320:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 184us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863721.101466:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00010000:00010000:0.0:1788863721.101516:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.101525:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863721.101543:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788863721.101676:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b695ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 62 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.101706:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 61 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.101714:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863721.101717:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788863721.101720:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fc00, rc 0) 00000100:00100000:0.0:1788863721.101748:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11404:x1875759205512192:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 6346us (6559us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788863721.101755:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:2.0:1788863721.105748:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863721.108537:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205512576 00000100:00100000:1.0:1788863721.108556:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205512576 00000100:00100000:1.0:1788863721.108630:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1788863721.108640:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11404:x1875759205512576:12345-192.168.204.35@tcp:103:lfs.0 00010000:00010000:1.0:1788863721.108720:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863721.108748:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69526 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ff3 expref: 61 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.108831:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863721.108836:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863721.108953:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:11404:x1875759205512576:12345-192.168.204.35@tcp:103:lfs.0 Request processed in 314us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863721.108961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:2.0:1788863721.117875:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863721.118131:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205512704 00000100:00100000:1.0:1788863721.118141:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205512704 00000100:00100000:1.0:1788863721.118202:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:1.0:1788863721.118212:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:11404:x1875759205512704:12345-192.168.204.35@tcp:58:lfs.0 00010000:00010000:1.0:1788863721.118337:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.118375:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.118389:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863721.118555:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788863721.118637:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:11404:x1875759205512704:12345-192.168.204.35@tcp:58:lfs.0 Request processed in 426us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863721.118645:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:0.0:1788863721.123200:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863721.123316:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205512832 00000100:00100000:2.0:1788863721.123327:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205512832 00000100:00100000:3.0:1788863721.123402:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:3.0:1788863721.123427:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:11404:x1875759205512832:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863721.123454:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863721.123948:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518802b expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.124020:0:12972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.124033:0:12972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 61 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.124055:0:12972:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.124068:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 61 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.124119:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863721.124122:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863721.124127:0:12972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 61 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863721.124265:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641378a00, rc 0) 00000100:00100000:2.0:1788863721.124532:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11404:x1875759205512832:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1106us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863721.124540:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 123 00010000:00010000:0.0:1788863721.646013:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863722.091582:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863722.091592:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863722.091641:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788863722.091652:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863722.091791:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8a9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226561408:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788863722.093342:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a92840 going to sleep for 11 seconds 00000100:00100000:0.0:1788863722.098939:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.099136:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205512960 00000100:00100000:2.0:1788863722.099147:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205512960 00000100:00100000:1.0:1788863722.099185:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8a9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226561408:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1788863722.099206:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863722.099278:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:2.0:1788863722.099292:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11406:x1875759205512960:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863722.099346:0:6536:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863722.099481:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11406:x1875759205512960:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 192us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.099488:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:2.0:1788863722.113952:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.115438:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205513088 00000100:00100000:0.0:1788863722.115452:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205513088 00000100:00100000:0.0:1788863722.115595:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:0.0:1788863722.115608:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11406:x1875759205513088:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788863722.115688:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115707:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115737:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115758:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115765:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115772:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115801:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115816:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115822:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863722.115871:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788863722.115875:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863722.115888:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115898:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.115904:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117488:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117503:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863722.117508:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117517:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117533:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:0.0:1788863722.117537:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863722.117542:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117548:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b695f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117567:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117573:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117579:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117584:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863722.117587:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117610:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117618:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff89e651feff00) 00010000:00010000:0.0:1788863722.117621:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863722.117624:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117630:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b695f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117646:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117653:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117658:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117663:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863722.117666:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117672:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117680:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863722.117682:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863722.117685:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.117702:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b695ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863722.117813:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11406:x1875759205513088:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 Request processed in 2204us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863722.117822:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:1.0:1788863722.129313:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.129479:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205513344 00000100:00100000:2.0:1788863722.129490:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205513344 00000100:00100000:2.0:1788863722.129629:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:2.0:1788863722.129640:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:11406:x1875759205513344:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863722.129666:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863722.129687:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69606 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188032 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129796:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129811:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129824:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863722.129836:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788863722.129914:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129922:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129948:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129954:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863722.129958:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129972:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.129985:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788863722.129988:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788863722.129992:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.130010:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6960d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.130054:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69606 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188032 expref: 63 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.130065:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:2.0:1788863722.130067:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863722.130071:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69606 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188032 expref: 63 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.130202:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99600, rc 0) 00000100:00100000:2.0:1788863722.130282:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:11406:x1875759205513344:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 643us (989us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788863722.130307:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:1.0:1788863722.156163:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.156391:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205513472 00000100:00100000:2.0:1788863722.156401:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205513472 00000100:00100000:2.0:1788863722.156522:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:2.0:1788863722.156533:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:11406:x1875759205513472:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863722.156572:0:6536:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863722.156693:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:11406:x1875759205513472:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 161us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.156701:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:3.0:1788863722.183303:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.183459:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205513728 00000100:00100000:0.0:1788863722.183470:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205513728 00000100:00100000:0.0:1788863722.183668:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:0.0:1788863722.183679:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:11406:x1875759205513728:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863722.183701:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863722.183704:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788863722.183731:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b695ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188016 expref: 62 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.183753:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863722.183757:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863722.183770:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b6961b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188039 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863722.184221:0:6537:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788863722.184374:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.184388:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.184399:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.184472:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b6961b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188039 expref: 64 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.184488:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188039 expref: 63 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.184496:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651feff00) 00010000:00010000:0.0:1788863722.184499:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863722.184501:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a400, rc 0) 00000100:00100000:0.0:1788863722.184648:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+63:11406:x1875759205513728:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 971us (1356us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788863722.184656:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:1.0:1788863722.195648:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.196402:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205513984 00000100:00100000:2.0:1788863722.196415:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205513984 00000100:00100000:2.0:1788863722.196494:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 129 00000100:00100000:2.0:1788863722.196505:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+63:11406:x1875759205513984:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863722.196581:0:12972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863722.196611:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b69622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188039 expref: 63 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196634:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651feff00) 00010000:00010000:2.0:1788863722.196644:0:12972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863722.196670:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196687:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196698:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196735:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196743:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196750:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196794:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196802:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196809:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196815:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863722.196821:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196830:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196839:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788863722.196854:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863722.196858:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196865:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69630 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196881:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196887:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196893:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196898:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863722.196901:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196906:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196914:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x445b7324 (ffff89e54382e800) 00010000:00010000:2.0:1788863722.196917:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863722.196920:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.196926:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69637 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x445b7324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.197033:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:11406:x1875759205513984:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 529us (1394us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863722.197041:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 129 00000100:00100000:2.0:1788863722.204365:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.204405:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205514112 00000100:00100000:0.0:1788863722.204416:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205514112 00000100:00100000:0.0:1788863722.204485:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:0.0:1788863722.204495:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:11406:x1875759205514112:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863722.204522:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863722.204544:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6963e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188040 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.204872:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.204886:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.204898:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.205016:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6963e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 64 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.205037:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 63 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.205046:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:0.0:1788863722.205049:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863722.205053:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b800, rc 0) 00000100:00100000:0.0:1788863722.205162:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+63:11406:x1875759205514112:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 668us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863722.205169:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:0.0:1788863722.223347:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863722.223469:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205514368 00000100:00100000:3.0:1788863722.223480:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205514368 00000100:00100000:3.0:1788863722.223547:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:3.0:1788863722.223558:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+63:11406:x1875759205514368:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863722.223661:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.223679:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.223692:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863722.225370:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1788863722.225389:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389349311658ns, next at 390349307538ns, rc = 0 00000004:00010000:3.0:1788863722.225458:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2c92eb4 reply state 000000002dff4cf4 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.225478:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.225486:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:3.0:1788863722.225489:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788863722.225493:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863722.225628:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:11406:x1875759205514368:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 2067us (2287us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788863722.225636:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:3.0:1788863722.233977:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.234155:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205514496 00000100:00100000:2.0:1788863722.234180:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205514496 00000100:00100000:2.0:1788863722.234320:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00100000:2.0:1788863722.234331:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:11406:x1875759205514496:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863722.234357:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863722.234377:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188047 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.234433:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 66 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.234447:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 66 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.234466:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:2.0:1788863722.234470:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863722.234482:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:2.0:1788863722.234547:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:11406:x1875759205514496:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 218us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.234554:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00100000:2.0:1788863722.249356:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863722.249481:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205514624 00000100:00100000:3.0:1788863722.249492:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205514624 00000100:00100000:3.0:1788863722.249602:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:3.0:1788863722.249613:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205514624:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788863722.249883:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2409:x1875759205514624:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 271us (543us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788863722.249906:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00080000:2.0:1788863722.251320:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863722.253972:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.254130:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205514880 00000100:00100000:2.0:1788863722.254140:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205514880 00000100:00100000:2.0:1788863722.254191:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:2.0:1788863722.254201:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:11406:x1875759205514880:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788863722.254445:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:11406:x1875759205514880:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 244us (481us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788863722.254470:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:1.0:1788863722.258613:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.258736:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205515136 00000100:00100000:0.0:1788863722.258747:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205515136 00000100:00100000:0.0:1788863722.258821:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:0.0:1788863722.258832:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:11406:x1875759205515136:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863722.258958:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:11406:x1875759205515136:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 128us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863722.258967:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:1.0:1788863722.270056:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863722.270179:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205515264 00000100:00100000:3.0:1788863722.270189:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205515264 00000100:00100000:3.0:1788863722.270265:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:3.0:1788863722.270277:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:11406:x1875759205515264:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863722.270300:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863722.270321:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650115400/0xf569beb9d4b6965a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518804e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.270392:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.270409:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.270422:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863722.270466:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863722.270485:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.270509:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650115400/0xf569beb9d4b6965a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518804e expref: 69 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.270528:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518804e expref: 68 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.270557:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:3.0:1788863722.270560:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788863722.270564:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650114a00, rc 0) 00000100:00100000:3.0:1788863722.270638:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:11406:x1875759205515264:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 363us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.270645:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:3.0:1788863722.275693:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863722.275858:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205515392 00000100:00100000:1.0:1788863722.275871:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205515392 00000100:00100000:1.0:1788863722.275986:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:1.0:1788863722.275996:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205515392:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863722.276015:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863722.276037:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188055 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788863722.276062:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe4ea, blocks: 0x0 00010000:00010000:1.0:1788863722.276124:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1788863722.276154:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863722.276164:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 10 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.276187:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 10 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.276200:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e000, rc 0) 00000100:00100000:1.0:1788863722.276273:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2408:x1875759205515392:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 279us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.276281:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:3.0:1788863722.282806:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.283528:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205515648 00000100:00100000:0.0:1788863722.283539:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205515648 00000100:00100000:0.0:1788863722.283606:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:0.0:1788863722.283615:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:11406:x1875759205515648:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863722.283726:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:11406:x1875759205515648:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 112us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863722.283747:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:2.0:1788863722.296351:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863722.296417:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205515776 00000100:00100000:3.0:1788863722.296428:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205515776 00000100:00100000:3.0:1788863722.296562:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:3.0:1788863722.296574:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:11406:x1875759205515776:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863722.296593:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863722.296611:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518805c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.296654:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.296665:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863722.296669:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863722.296674:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 11 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.296712:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.296750:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 11 pid: 8452 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.296765:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226561536:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863722.296878:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863722.301783:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226561536:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863722.301821:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 11 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.301844:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650115400, rc 0) 00000100:00100000:2.0:1788863722.301914:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:11406:x1875759205515776:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 5343us (5573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.301924:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:1.0:1788863722.302601:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.302662:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205515904 00000100:00100000:2.0:1788863722.302670:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205515904 00010000:00010000:2.0:1788863722.302707:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 11 pid: 8452 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.302751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:2.0:1788863722.302760:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2409:x1875759205515904:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863722.302774:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863722.302876:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 11 pid: 8452 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.302890:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 11 pid: 8452 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.302933:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b69668 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188055 expref: 11 pid: 8452 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.302950:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863722.302953:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863722.302962:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.302972:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.303021:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.303035:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6524:1875759226561664:192.168.204.35@tcp:105: 00000100:00100000:2.0:1788863722.303163:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d540600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863722.310024:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6524:1875759226561664:192.168.204.35@tcp:105: 00010000:00010000:2.0:1788863722.310054:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863722.310165:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2409:x1875759205515904:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 7405us (7565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.310175:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:3.0:1788863722.312579:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.312792:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205516032 00000100:00100000:2.0:1788863722.312803:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205516032 00002000:00100000:2.0:1788863722.312845:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff89e67f899880 x1875759205516032/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:708/0 lens 504/0 e 0 to 0 dl 1788863733 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863722.312868:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e67f899880 with x1875759205516032 ext(0->12) 00002000:00010000:2.0:1788863722.312874:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e67f899880 00000100:00100000:2.0:1788863722.312911:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:2.0:1788863722.312921:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2408:x1875759205516032:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788863722.314894:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:2408:x1875759205516032:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 Request processed in 1965us (2315us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788863722.314907:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00002000:00100000:2.0:1788863722.314920:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff89e67f899880 x1875759205516032/t4294967309(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:708/0 lens 504/448 e 0 to 0 dl 1788863733 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863722.314930:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e67f899880 with x1875759205516032 ext(0->12) 00002000:00010000:2.0:1788863722.314937:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e67f899880 00000100:00100000:1.0:1788863722.327978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.328419:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205516160 00000100:00100000:2.0:1788863722.328430:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205516160 00000100:00100000:2.0:1788863722.328513:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:2.0:1788863722.328524:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:11406:x1875759205516160:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788863722.341721:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788863722.341746:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788863722.341866:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788863722.341903:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e544077900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788863722.341908:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e65015dc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e658790f00 00000020:00080000:0.0:1788863722.341912:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e65015d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e6412e6800 00000004:00080000:0.0:1788863722.341949:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:1.0:1788863722.342015:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342031:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342041:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342048:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863722.342055:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342066:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342141:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff89e675672000) 00010000:00010000:1.0:1788863722.342176:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863722.342183:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342210:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378e00/0xf569beb9d4b69374 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.342228:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788863722.342250:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.342259:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226561792:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788863722.342263:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342285:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342292:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863722.342295:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342301:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342313:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff89e675672600) 00010000:00010000:1.0:1788863722.342316:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863722.342320:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342326:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114600/0xf569beb9d4b6941c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342347:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342367:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342373:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.342380:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863722.342394:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863722.342398:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342404:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342413:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:1.0:1788863722.342415:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863722.342418:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342424:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378400/0xf569beb9d4b6949a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342437:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342443:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342450:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342456:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259aa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863722.342467:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342473:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342482:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e675672100) 00010000:00010000:1.0:1788863722.342484:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863722.342488:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342507:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b694bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342525:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342532:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342538:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342543:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641378200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863722.342546:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342553:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342562:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863722.342564:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863722.342574:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342581:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378200/0xf569beb9d4b6958f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342595:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342602:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342609:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342616:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641379c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863722.342619:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342627:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342638:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:1.0:1788863722.342641:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788863722.342645:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.342651:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379c00/0xf569beb9d4b6964c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.342652:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226561792 00000100:00100000:3.0:1788863722.342666:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226561792 00000100:00100000:3.0:1788863722.342739:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863722.342750:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226561792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788863722.342774:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1788863722.342807:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fe4e8, atime: 0x0, ctime: 0x6a9fe4e8, blocks: 0x8 00010000:00010000:3.0:1788863722.342816:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.342832:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1788863722.342837:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863722.342843:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.342859:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.342882:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.342890:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.342910:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788863722.343063:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226561792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 315us (683us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788863722.343070:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1788863722.343120:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863722.343126:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.343134:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863722.343139:0:9549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.343159:0:9549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.343174:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.343182:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011ed19a4/0xf569beb9d4b69676 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.343218:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863722.343220:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863722.343222:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863722.343250:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788863722.343256:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:3.0:1788863722.343277:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e543bf3800, transno 4294967302 00000004:00080000:3.0:1788863722.343286:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:3.0:1788863722.343304:0:3642:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89e67f89aa00 x1875759226561792/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788863738 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788863722.343315:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e67f89aa00/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788863722.343322:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226561792:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788863722.343586:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1788863722.345158:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788863722.352403:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226561920:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788863722.352531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863722.352647:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863722.352659:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226562048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788863722.352685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863722.352722:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226561920 00000100:00100000:2.0:1788863722.352731:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226561920 00000100:00100000:2.0:1788863722.352797:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226562048 00000100:00100000:2.0:1788863722.352819:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226562048 00000100:00100000:2.0:1788863722.352849:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788863722.352859:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1875759226561920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788863722.352908:0:8451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1788863722.352940:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.352968:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.352977:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788863722.352982:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863722.352986:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.353020:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.353037:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 11 pid: 8450 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.353050:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226562176:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863722.353173:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d540600 going to sleep for 11 seconds 00000100:00080000:2.0:1788863722.353189:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863722.353215:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788863722.353225:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1875759226562048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788863722.353382:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788863722.353387:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788863722 00002000:00010000:2.0:1788863722.353390:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788863722.353392:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788863722 -> 1788863722 00002000:00010000:2.0:1788863722.353394:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788863722.353445:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3640:x1875759226562048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (758us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788863722.353453:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1788863722.353507:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e5440d1500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788863722.353514:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226562048:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788863722.353857:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e661f31780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788863722.353864:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e65015df00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e661f319c0 00000020:00080000:0.0:1788863722.353867:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e65015d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e5440d6a00 00000100:00100000:3.0:1788863722.354735:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11406:x1875759205516160:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 Request processed in 26206us (26761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.354747:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 136 00000020:00080000:1.0:1788863722.354936:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788863722.355004:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788863722.360764:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.360937:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1875759226562176:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863722.360989:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.361345:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205516288 00000100:00100000:3.0:1788863722.361355:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205516288 00010000:00010000:3.0:1788863722.361478:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 12 pid: 8450 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.361525:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:3.0:1788863722.361537:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:2408:x1875759205516288:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863722.361555:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863722.361561:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 12 pid: 8450 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.361615:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 12 pid: 8450 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.361657:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069bc3f3c/0xf569beb9d4b6942a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187fb4 expref: 12 pid: 8450 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.361681:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863722.361689:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863722.361699:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.361716:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.361771:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863722.363177:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.363455:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.363474:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.363483:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.363543:0:8451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863722.363786:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863722.363796:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.363806:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863722.363812:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.363824:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.363828:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3640:x1875759226561920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10966us (11295us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788863722.363846:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1788863722.363855:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.363876:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6967d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.363903:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863722.363907:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863722.363908:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863722.364586:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2408:x1875759205516288:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 3042us (3829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.364599:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000004:00080000:1.0:1788863722.366217:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e5440d1180/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788863722.366236:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226561920:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788863722.370858:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.373290:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205516416 00000100:00100000:2.0:1788863722.373310:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205516416 00000100:00100000:2.0:1788863722.373411:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:2.0:1788863722.373423:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2409:x1875759205516416:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788863722.382187:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788863722.382213:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1788863722.383604:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205516416:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 Request processed in 10175us (12754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.383616:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788863722.389500:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.389801:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205516672 00000100:00100000:2.0:1788863722.389813:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205516672 00000100:00100000:2.0:1788863722.389876:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:2.0:1788863722.389886:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11406:x1875759205516672:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863722.389954:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863722.389988:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650114a00/0xf569beb9d4b69661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518804e expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.390011:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:2.0:1788863722.390017:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863722.390053:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.390070:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.390502:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863722.390787:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c51594f5 reply state 0000000023d615a5 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.390800:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.390807:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:2.0:1788863722.390810:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863722.390813:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863722.390917:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:11406:x1875759205516672:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 1031us (1429us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788863722.390926:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:0.0:1788863722.395802:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863722.395891:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205516800 00000100:00100000:3.0:1788863722.395902:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205516800 00000100:00100000:3.0:1788863722.395959:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:3.0:1788863722.395969:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205516800:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788863722.396192:0:8606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788863722.396196:0:8606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788863722 -> 1788863721 00002000:00010000:3.0:1788863722.396198:0:8606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788863720 00002000:00010000:3.0:1788863722.396225:0:8606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788863722 -> 1788863721 00002000:00010000:3.0:1788863722.396227:0:8606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788863722.396283:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205516800:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 313us (490us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788863722.396291:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:1.0:1788863722.407957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.408044:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205517056 00000100:00100000:0.0:1788863722.408054:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205517056 00000100:00100000:0.0:1788863722.408132:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:0.0:1788863722.408143:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:11406:x1875759205517056:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788863722.408234:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.408253:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.408264:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.408299:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.408313:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 17 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863722.408347:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875759226562304:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863722.408450:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a92840 going to sleep for 11 seconds 00000100:00100000:0.0:1788863722.420606:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863722.420784:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875759226562304:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863722.420812:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.422382:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205517184 00000100:00100000:2.0:1788863722.422396:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205517184 00010000:00010000:2.0:1788863722.422442:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 18 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.422563:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:2.0:1788863722.422573:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:2409:x1875759205517184:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863722.422591:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863722.422599:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 18 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.422612:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 18 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.422666:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188040 expref: 18 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.422684:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:2.0:1788863722.422689:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.422698:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.422705:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.422739:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863722.422774:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.422782:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.422796:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:2409:x1875759205517184:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 226us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.422803:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00010000:00010000:1.0:1788863722.422818:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.423023:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.423038:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.423044:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ae00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863722.423050:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.423058:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.423099:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:1.0:1788863722.423103:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788863722.423107:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.423114:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6968b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.423178:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11406:x1875759205517056:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 Request processed in 15037us (15241us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788863722.423187:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:0.0:1788863722.439850:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863722.439942:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205517312 00000100:00100000:3.0:1788863722.439954:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205517312 00000100:00100000:3.0:1788863722.440017:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:3.0:1788863722.440039:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205517312:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788863722.440120:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.440141:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.440151:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863722.440470:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863722.440476:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.440517:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.440533:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 7 pid: 8451 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.440552:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1875759226562432:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863722.440656:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863722.453735:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.453885:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205517440 00000100:00100000:2.0:1788863722.453896:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205517440 00010000:00010000:2.0:1788863722.453948:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 8 pid: 8451 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.453994:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:2.0:1788863722.454004:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205517440:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863722.454021:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863722.454056:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 8 pid: 8451 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.454130:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 8 pid: 8451 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.454167:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863722.454172:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863722.454177:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.454189:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.454223:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863722.454271:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205517440:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 269us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.454277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 74 00010000:00010000:3.0:1788863722.454857:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9386cdc/0xf569beb9d4b6966f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518805c expref: 7 pid: 8451 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.454876:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1875759226562432:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863722.454898:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.454909:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.454917:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.454939:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.454948:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.454956:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.454963:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863722.454968:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.454992:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.455006:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.455014:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011ed19a4/0xf569beb9d4b69692 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.455137:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205517312:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 Request processed in 15110us (15303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.455146:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:0.0:1788863722.458987:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863722.459136:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205517696 00000100:00100000:3.0:1788863722.459147:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205517696 00000100:00100000:3.0:1788863722.459224:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:3.0:1788863722.459235:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:11406:x1875759205517696:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788863722.459315:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.459332:0:12972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.459342:0:12972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.459378:0:12972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.459409:0:12972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 16 pid: 6538 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.459424:0:12972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226562560:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863722.459506:0:12972:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863722.468403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863722.468766:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205517824 00000100:00100000:1.0:1788863722.468775:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205517824 00010000:00010000:1.0:1788863722.468815:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 17 pid: 6538 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.468859:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:1.0:1788863722.468867:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:2409:x1875759205517824:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863722.468881:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863722.468888:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 17 pid: 6538 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.468900:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 17 pid: 6538 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.468923:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863722.468930:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 17 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.468956:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.468964:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.468972:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.469003:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863722.469332:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:2409:x1875759205517824:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 465us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.469340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 75 00010000:00010000:3.0:1788863722.470015:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641379e00/0xf569beb9d4b69588 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188008 expref: 16 pid: 6538 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.470044:0:12972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226562560:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863722.470066:0:12972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.470120:0:12972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.470128:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.470929:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.470959:0:12972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 16 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.470968:0:12972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.471005:0:12972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 16 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.471401:0:12972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 16 pid: 10368 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.471419:0:12972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226562688:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863722.471512:0:12972:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863722.481041:0:12972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226562688:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863722.481073:0:12972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863722.483279:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.483509:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205517952 00000100:00100000:2.0:1788863722.483519:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205517952 00010000:00010000:2.0:1788863722.483559:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 17 pid: 10368 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.483597:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:2.0:1788863722.483607:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:2409:x1875759205517952:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863722.483632:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863722.483639:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 17 pid: 10368 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.483672:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 17 pid: 10368 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.483695:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188047 expref: 17 pid: 10368 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.483711:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:2.0:1788863722.483716:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.483725:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.483732:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.483766:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863722.483821:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:2409:x1875759205517952:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 216us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863722.483828:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 76 00010000:00010000:0.0:1788863722.484665:0:12972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.484676:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863722.484793:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788863722.484937:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788863722.484976:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788863722.486410:0:12972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12972:1875759226562816:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788863722.486505:0:12972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863722.486593:0:12972:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863722.486705:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226562816 00000100:00100000:3.0:1788863722.486713:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226562816 00000100:00100000:3.0:1788863722.486801:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788863722.486811:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12972:x1875759226562816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788863722.488479:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12972:x1875759226562816:12345-0@lo:1000:mdt00_004.0 Request processed in 1661us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.488493:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788863722.488585:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788863722.488592:0:12972:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1788863722.488614:0:12972:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e5440d1500, transno 4294967310 00000004:00080000:2.0:1788863722.488642:0:12972:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e5440d1180, transno 4294967311 00000100:00100000:2.0:1788863722.488652:0:12972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12972:1875759226562816:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788863722.488816:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788863722.488893:0:12972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12972:1875759226562944:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788863722.488958:0:12972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863722.492403:0:12972:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863722.492517:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226562944 00000100:00100000:1.0:1788863722.492528:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226562944 00000100:00100000:0.0:1788863722.492605:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788863722.492617:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12972:x1875759226562944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788863722.492840:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12972:x1875759226562944:12345-0@lo:1000:mdt00_004.0 Request processed in 226us (3882us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788863722.492848:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788863722.493704:0:12972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12972:1875759226562944:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788863722.493757:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493768:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493776:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493782:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863722.493787:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493795:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493813:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:2.0:1788863722.493816:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863722.493820:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493827:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b696a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493854:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493861:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493883:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493887:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863722.493891:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493897:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493906:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788863722.493908:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863722.493915:0:12972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493927:0:12972:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493936:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.493976:0:12972:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.493990:0:12972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226563072:192.168.204.35@tcp:105: 00000100:00100000:2.0:1788863722.494297:0:12972:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863722.510367:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863722.510493:0:12972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12972:1875759226563072:192.168.204.35@tcp:105: 00010000:00010000:2.0:1788863722.510560:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510571:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b695e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510609:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510637:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510649:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510662:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510668:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510675:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510682:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863722.510685:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510693:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510704:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788863722.510709:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863722.510720:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510726:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b696a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510737:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510743:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510748:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510752:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863722.510754:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510760:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510768:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788863722.510770:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788863722.510773:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.510777:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b69699 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.510958:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11406:x1875759205517696:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 51724us (51980us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788863722.510968:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 139 00000020:00080000:2.0:1788863722.510980:0:12972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788863722.511759:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863722.511765:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863722.512330:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788863722.512352:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863722.513455:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205518080 00000100:00100000:1.0:1788863722.513468:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205518080 00000100:00100000:1.0:1788863722.513530:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:1.0:1788863722.513540:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11404:x1875759205518080:12345-192.168.204.35@tcp:49:lfs.0 00000100:00100000:1.0:1788863722.513676:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11404:x1875759205518080:12345-192.168.204.35@tcp:49:lfs.0 Request processed in 137us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.513683:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:0.0:1788863722.517389:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863722.518405:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205518336 00000100:00100000:1.0:1788863722.518418:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205518336 00000100:00100000:1.0:1788863722.518506:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:1.0:1788863722.518517:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:11406:x1875759205518336:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788863722.518786:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788863722.518816:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1788863722.518846:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.518862:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.518873:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.518882:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.518888:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.518895:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.518969:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863722.519072:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11406:x1875759205518336:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 556us (1693us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788863722.520268:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00000020:00080000:1.0:1788863722.520277:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863722.521839:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863722.521852:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.521862:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863722.521866:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.521876:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.521893:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:2.0:1788863722.521896:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788863722.521901:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.521906:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b696ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863722.521922:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863722.521924:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863722.521926:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863722.523520:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.523614:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205518592 00000100:00100000:0.0:1788863722.523634:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205518592 00000100:00100000:0.0:1788863722.523693:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:0.0:1788863722.523703:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11404:x1875759205518592:12345-192.168.204.35@tcp:58:lfs.0 00000040:00080000:0.0:1788863722.523885:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788863722.523986:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11404:x1875759205518592:12345-192.168.204.35@tcp:58:lfs.0 Request processed in 284us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863722.523995:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:1.0:1788863722.605049:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.605173:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205518720 00000100:00100000:0.0:1788863722.605184:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205518720 00000100:00100000:0.0:1788863722.605263:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:0.0:1788863722.605273:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:11408:x1875759205518720:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863722.605297:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863722.605317:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b696b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188063 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605381:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605397:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605409:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605424:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605450:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605458:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605611:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605622:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 22 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605630:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605666:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 22 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.605681:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 22 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863722.605695:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875759226563200:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863722.606275:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d540600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863722.623696:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863722.623844:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875759226563200:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863722.623884:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863722.624211:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205518976 00000100:00100000:2.0:1788863722.624221:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205518976 00000100:00100000:2.0:1788863722.624409:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:2.0:1788863722.624422:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:6186:x1875759205518976:12345-192.168.204.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788863722.624690:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:6186:x1875759205518976:12345-192.168.204.35@tcp:35:ldlm_bl.0 Request processed in 270us (1004us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788863722.631491:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863722.631736:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205519104 00000100:00100000:1.0:1788863722.631747:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205519104 00010000:00010000:1.0:1788863722.631804:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 25 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.631849:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:1.0:1788863722.631859:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:2408:x1875759205519104:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863722.631873:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863722.631880:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 25 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.631895:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 25 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.631918:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b695d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188024 expref: 25 pid: 6536 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.631935:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863722.631941:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.631951:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.631959:0:10355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.631992:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863722.632044:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:2408:x1875759205519104:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 187us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.632052:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00010000:00010000:0.0:1788863722.633035:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633057:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863722.633149:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788863722.633154:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863722.633176:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633193:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633214:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633221:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633228:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633234:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259be00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863722.633239:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633247:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633259:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788863722.633263:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863722.633267:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633284:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633453:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633460:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633467:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633472:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863722.633475:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633481:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633490:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff89e681a6a000) 00010000:00010000:0.0:1788863722.633493:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863722.633496:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633502:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b696c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633544:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b696b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188063 expref: 24 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633558:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188063 expref: 23 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863722.633572:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863722.633575:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863722.633578:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259ae00, rc 0) 00000100:00100000:0.0:1788863722.635208:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:11408:x1875759205518720:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 29917us (30150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863722.635220:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:2.0:1788863722.637278:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00010000:00010000:3.0:1788863722.667260:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788863723.579789:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863723.579797:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863723.579838:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788863723.579845:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863723.580036:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226563328:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788863723.580155:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681d07540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863723.605353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863723.605554:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226563328:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863723.609226:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205519232 00000100:00100000:3.0:1788863723.609248:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205519232 00000100:00100000:3.0:1788863723.609339:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:3.0:1788863723.609351:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11419:x1875759205519232:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788863723.609401:0:12972:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788863723.612861:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11419:x1875759205519232:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 3490us (7500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863723.612909:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:3.0:1788863723.634623:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863723.634704:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205519488 00000100:00100000:0.0:1788863723.634721:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205519488 00000100:00100000:0.0:1788863723.634805:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 143 00000100:00100000:0.0:1788863723.634816:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:11419:x1875759205519488:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863723.634840:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863723.634910:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518806a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863723.635331:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b696d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863723.635348:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b696d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863723.635364:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b696d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863723.635375:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788863723.635521:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b696d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518806a expref: 25 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863723.635554:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b696d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518806a expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863723.635564:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788863723.635568:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863723.635571:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863723.635639:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:11419:x1875759205519488:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 823us (1032us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788863723.635647:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 143 00000100:00100000:0.0:1788863723.648325:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863723.648394:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863723.648493:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205519872 00000100:00100000:3.0:1788863723.648503:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205519616 00000100:00100000:3.0:1788863723.648514:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205519616 00000100:00100000:1.0:1788863723.648521:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205519872 00000100:00100000:1.0:1788863723.648605:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 144 00000100:00100000:1.0:1788863723.648620:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:11419:x1875759205519872:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788863723.648624:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788863723.648647:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:2411:x1875759205519616:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863723.648665:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863723.648690:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b696d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518806a expref: 25 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.648711:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863723.648718:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863723.648732:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.648756:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.648772:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863723.648780:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:2411:x1875759205519616:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 136us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863723.648795:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00010000:00010000:1.0:1788863723.649008:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.649020:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.649028:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.649036:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863723.649061:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.649071:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.649200:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:1.0:1788863723.649203:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788863723.649209:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863723.649217:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b696e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863723.649420:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:11419:x1875759205519872:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 801us (1022us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788863723.649430:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 144 00000040:00080000:1.0:1788863723.649652:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863723.649658:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863723.650246:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788863723.650258:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863723.655521:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863723.655713:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205520128 00000100:00100000:3.0:1788863723.655724:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205520128 00000100:00100000:3.0:1788863723.655783:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:3.0:1788863723.655793:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:11419:x1875759205520128:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788863723.656039:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:11419:x1875759205520128:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 247us (530us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788863723.656048:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00010000:00010000:0.0:1788863723.696613:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863723.773934:0:14281:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863723.773944:0:14281:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863723.773980:0:14281:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788863723.773990:0:14281:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863723.923794:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863723.923939:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205520384 00000100:00100000:3.0:1788863723.923951:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205520384 00000100:00100000:3.0:1788863723.924051:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:3.0:1788863723.924063:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:11432:x1875759205520384:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863723.924122:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863723.924148:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b696ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188071 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.924277:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b696f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.924293:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b696f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.924309:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b696f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863723.924322:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788863723.924497:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91a00/0xf569beb9d4b696ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188071 expref: 28 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.924515:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b696f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188071 expref: 27 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.924524:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863723.924527:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788863723.924536:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d90800, rc 0) 00000100:00100000:3.0:1788863723.924597:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:11432:x1875759205520384:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 536us (819us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788863723.924605:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:1.0:1788863723.932428:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863723.932509:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205520512 00000100:00100000:3.0:1788863723.932520:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205520512 00000100:00100000:3.0:1788863723.932574:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:3.0:1788863723.932594:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:11432:x1875759205520512:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:3.0:1788863723.932677:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932698:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932712:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932750:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932759:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932767:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932775:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863723.932779:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932788:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932802:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:3.0:1788863723.932806:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863723.932811:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863723.932818:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d91200/0xf569beb9d4b69702 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863723.932898:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:11432:x1875759205520512:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 307us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863723.932907:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:1.0:1788863724.075580:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863724.076778:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205520640 00000100:00100000:0.0:1788863724.076791:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205520640 00000100:00100000:0.0:1788863724.076891:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:0.0:1788863724.076906:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205520640:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:0.0:1788863724.076925:0:8606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863724.076959:0:8606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f35383/0xf569beb9d4b69709 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188078 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863724.076986:0:8606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fe4e9, atime: 0x6a9fe4e8, ctime: 0x6a9fe4e9, blocks: 0x8 00010000:00010000:0.0:1788863724.077006:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1788863724.077011:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863724.077021:0:8606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f35383/0xf569beb9d4b69709 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188078 expref: 7 pid: 8606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.077040:0:8606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013f35383/0xf569beb9d4b69709 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188078 expref: 7 pid: 8606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.077053:0:8606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a600, rc 0) 00000100:00100000:0.0:1788863724.077604:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2410:x1875759205520640:12345-192.168.204.35@tcp:101:cat.0 Request processed in 701us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.077612:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00080000:2.0:1788863724.079404:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863724.093198:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863724.093769:0:8458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205520768 00000100:00100000:1.0:1788863724.093781:0:8458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205520768 00002000:00100000:1.0:1788863724.093859:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff89e5440d0700 x1875759205520768/t0(0) o3->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:710/0 lens 488/0 e 0 to 0 dl 1788863735 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788863724.093871:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e5440d0700 with x1875759205520768 ext(0->4095) 00002000:00010000:1.0:1788863724.093877:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e5440d0700 00000100:00100000:1.0:1788863724.094021:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:1.0:1788863724.094032:0:8458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205520768:12345-192.168.204.35@tcp:3:cat.0 00000100:00100000:1.0:1788863724.094523:0:8458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205520768:12345-192.168.204.35@tcp:3:cat.0 Request processed in 493us (1335us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788863724.094532:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00002000:00100000:1.0:1788863724.094540:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff89e5440d0700 x1875759205520768/t0(0) o3->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:710/0 lens 488/4536 e 0 to 0 dl 1788863735 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788863724.094549:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e5440d0700 with x1875759205520768 ext(0->4095) 00002000:00010000:1.0:1788863724.094553:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e5440d0700 00000100:00100000:1.0:1788863724.523403:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226563456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863724.523533:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863724.523645:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863724.523653:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226563584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863724.523675:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863724.526428:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226563456 00000100:00100000:0.0:1788863724.526429:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226563584 00000100:00100000:0.0:1788863724.526444:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226563584 00000100:00100000:2.0:1788863724.526445:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226563456 00000100:00080000:3.0:1788863724.526615:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863724.526620:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788863724.527597:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226563584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863724.527635:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788863724.527718:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226563584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1090us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.527726:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788863724.527745:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788863724.527752:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226563456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863724.527777:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788863724.527801:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226563456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.527807:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788863724.528266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226563584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863724.528286:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226563456:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788863724.652280:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863724.652291:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863724.652335:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788863724.652345:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788863724.652897:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863724.715346:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863725.036503:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226563712:0@lo:400:kworker.0 00000100:00100000:2.0:1788863725.036576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863725.037065:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226563712 00000100:00100000:0.0:1788863725.037073:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226563712 00000100:00100000:0.0:1788863725.037163:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788863725.037179:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226563712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863725.037414:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226563840:0@lo:400:kworker.0 00000100:00100000:3.0:1788863725.037455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863725.037497:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226563840 00000100:00100000:3.0:1788863725.037501:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226563840 00000100:00100000:3.0:1788863725.037534:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788863725.037540:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226563840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863725.037580:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226563840:12345-0@lo:400:kworker.0 Request processed in 40us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863725.037588:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788863725.037632:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226563840:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.042906:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226563712:12345-0@lo:400:kworker.0 Request processed in 5725us (6319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.042923:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788863725.043054:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863725.043108:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863725.043137:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863725.043549:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863725.043567:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226563968:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.043614:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863725.043668:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226564096:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.044268:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863725.044383:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205520896 00000100:00100000:2.0:1788863725.044391:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205520896 00000100:00100000:2.0:1788863725.044441:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 387 00000100:00100000:2.0:1788863725.044450:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205520896:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863725.045527:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863725.045553:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863725.045575:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863725.045600:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521152 00000100:00100000:0.0:1788863725.045606:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521152 00000100:00100000:0.0:1788863725.045641:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521664 00000100:00100000:0.0:1788863725.045644:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521664 00000100:00100000:0.0:1788863725.045655:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521024 00000100:00100000:0.0:1788863725.045656:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521024 00000100:00100000:0.0:1788863725.045668:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521536 00000100:00100000:0.0:1788863725.045670:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521536 00000100:00100000:0.0:1788863725.046457:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 314 00000100:00100000:0.0:1788863725.046467:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205521152:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863725.046554:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205521152:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 88us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.046562:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 314 00000100:00100000:0.0:1788863725.046579:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 315 00000100:00100000:0.0:1788863725.046585:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205521664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863725.046606:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205521664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.046611:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 315 00000100:00100000:0.0:1788863725.046620:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 316 00000100:00100000:0.0:1788863725.046625:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:2411:x1875759205521024:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863725.046644:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:2411:x1875759205521024:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 20us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.046649:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 316 00000100:00100000:0.0:1788863725.046659:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 317 00000100:00100000:0.0:1788863725.046665:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205521536:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863725.046839:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205521536:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 173us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.046846:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 317 00000100:00080000:0.0:1788863725.048649:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863725.048657:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863725.048945:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226563968 00000100:00100000:0.0:1788863725.048953:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226563968 00000100:00100000:0.0:1788863725.048992:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788863725.048999:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226563968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.049310:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226563968:12345-0@lo:400:kworker.0 Request processed in 311us (5695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.049318:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788863725.049344:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226564480:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.049373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863725.049395:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226564992:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.049414:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863725.049430:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788863725.049434:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226564608:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.049452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863725.049465:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226565120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.049479:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863725.049499:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521408 00000100:00100000:0.0:1788863725.049502:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521408 00000100:00100000:0.0:1788863725.049526:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521280 00000100:00100000:0.0:1788863725.049528:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521280 00000100:00100000:0.0:1788863725.049538:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564608 00000100:00100000:0.0:1788863725.049540:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564608 00000100:00100000:0.0:1788863725.049549:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226565120 00000100:00100000:0.0:1788863725.049550:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226565120 00000100:00100000:0.0:1788863725.049564:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:0.0:1788863725.049570:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205521408:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863725.049607:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205521408:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 37us (6470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.049613:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:0.0:1788863725.049624:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:0.0:1788863725.049635:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205521280:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863725.049657:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205521280:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (4103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.049662:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:0.0:1788863725.049671:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863725.049675:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226564608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.049700:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226564608:12345-0@lo:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.049705:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863725.049894:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788863725.049904:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226565120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.049934:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226565120:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.049939:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788863725.049957:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564480 00000100:00100000:0.0:1788863725.049960:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564480 00000100:00100000:0.0:1788863725.049983:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564992 00000100:00100000:0.0:1788863725.049986:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564992 00000100:00100000:0.0:1788863725.050003:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788863725.050008:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226564480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.051739:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863725.051807:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226563968:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.051881:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564096 00000100:00100000:1.0:1788863725.051887:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564096 00000100:00100000:1.0:1788863725.051921:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788863725.051930:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226564992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.051975:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226564992:12345-0@lo:400:kworker.0 Request processed in 47us (2560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863725.051982:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788863725.052000:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788863725.052005:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226564096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.052058:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226564096:12345-0@lo:400:kworker.0 Request processed in 45us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863725.052064:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788863725.052111:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226564096:0@lo:400:kworker.0 00000100:00080000:1.0:1788863725.052159:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863725.052166:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863725.052468:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226564608:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.052482:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226565120:0@lo:400:kworker.0 00010000:00080000:1.0:1788863725.052495:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5441c2d80 x1875759226564480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863725.052505:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226564480:0@lo:400:kworker.0 00010000:00080000:1.0:1788863725.052515:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5441c3100 x1875759226564992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863725.052522:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226564992:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.052652:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226564352:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.052686:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863725.052708:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226564864:0@lo:400:kworker.0 00000100:00100000:2.0:1788863725.053491:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d92bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205520896:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 9036us (10453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863725.053502:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 387 00000100:00100000:0.0:1788863725.053778:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226564480:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.053788:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788863725.053893:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564352 00000100:00100000:0.0:1788863725.053901:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564352 00000100:00100000:0.0:1788863725.054050:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788863725.054070:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226564352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.054142:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226564352:12345-0@lo:400:kworker.0 Request processed in 74us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.054163:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00080000:2.0:1788863725.054247:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863725.056259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863725.056331:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226564352:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.056349:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788863725.056359:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226564224:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.056389:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863725.056424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226564736:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.056449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863725.056467:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226565248:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.056487:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863725.056531:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564736 00000100:00100000:1.0:1788863725.056537:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564736 00000100:00100000:1.0:1788863725.056571:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226565248 00000100:00100000:1.0:1788863725.056573:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226565248 00000100:00100000:1.0:1788863725.056597:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788863725.056603:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226564736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.056652:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226564736:12345-0@lo:400:kworker.0 Request processed in 49us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863725.056659:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788863725.056674:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788863725.056681:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226565248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.056709:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226565248:12345-0@lo:400:kworker.0 Request processed in 30us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863725.057027:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788863725.057192:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226563712:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.057295:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226564736:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.057304:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226565248:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.057405:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564864 00000100:00100000:0.0:1788863725.057411:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564864 00000100:00100000:0.0:1788863725.057454:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788863725.057462:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226564864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863725.057588:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226564224 00000100:00100000:2.0:1788863725.057592:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226564224 00000100:00100000:2.0:1788863725.057625:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788863725.057632:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226564224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.058118:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226564864:12345-0@lo:400:kworker.0 Request processed in 655us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863725.058125:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788863725.059231:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226564224:12345-0@lo:400:kworker.0 Request processed in 1596us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863725.059241:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1788863725.059269:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863725.059274:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863725.059344:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226564224:0@lo:400:kworker.0 00000100:00100000:0.0:1788863725.059359:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226564864:0@lo:400:kworker.0 00000100:00100000:1.0:1788863725.547609:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863725.547632:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226565504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863725.547706:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863725.547904:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226565504 00000100:00100000:2.0:1788863725.547913:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226565504 00000100:00100000:2.0:1788863725.547969:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788863725.547979:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226565504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863725.548009:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863725.548091:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226565504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863725.548100:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788863725.548669:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226565504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863725.548818:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226565376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863725.548859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863725.548942:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226565376 00000100:00100000:2.0:1788863725.548947:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226565376 00000100:00100000:2.0:1788863725.548971:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788863725.548980:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226565376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863725.548995:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863725.549036:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226565376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863725.549043:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788863725.550064:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226565376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788863725.741341:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863726.059757:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863726.059805:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226565632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863726.059903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863726.060001:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226565632 00000100:00100000:2.0:1788863726.060011:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226565632 00000100:00100000:2.0:1788863726.060399:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788863726.060410:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226565632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863726.060527:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788863726.060594:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226565632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 185us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863726.060602:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788863726.060661:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226565632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863726.064158:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226565760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863726.064267:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863726.065597:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226565760 00000100:00100000:2.0:1788863726.065615:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226565760 00000100:00100000:2.0:1788863726.065714:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788863726.065725:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226565760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863726.065793:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863726.065889:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226565760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863726.065896:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788863726.069750:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226565760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788863726.763781:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788863727.605892:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1788863727.605915:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788863727.606247:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788863727.618543:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788863727.618612:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e676302540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788863727.618619:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e65015d500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e676302e40 00000020:00080000:2.0:1788863727.618625:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e65015d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e6438d7400 00010000:00010000:1.0:1788863727.618628:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863727.618650:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788863727.618654:0:6516:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:1.0:1788863727.618663:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863727.618686:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863727.618693:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863727.618701:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863727.618722:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff89e651fef600) 00010000:00010000:1.0:1788863727.618726:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863727.618732:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863727.618760:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69684 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788863727.619853:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788863727.619968:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788863727.787475:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863728.811220:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863729.643263:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863729.643285:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226565888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863729.643317:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226566016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863729.643350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863729.643379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863729.643423:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566016 00000100:00100000:3.0:1788863729.643442:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566016 00000100:00100000:2.0:1788863729.643456:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226565888 00000100:00100000:2.0:1788863729.643460:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226565888 00000100:00100000:3.0:1788863729.643495:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788863729.643503:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226565888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863729.643597:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788863729.643640:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226565888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863729.648518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226565888:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788863729.649272:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863729.654300:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788863729.655119:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788863729.655139:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226566016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863729.655166:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788863729.655245:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226566016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (11894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863729.655252:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788863729.655306:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788863729.655312:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1788863729.655342:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226566016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863729.836620:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863730.156290:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226566144:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.156376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863730.156418:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226566528:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.156462:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226566656:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.156489:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863730.156511:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226567168:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.156532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863730.156548:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226567680:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.156567:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863730.156672:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226566272:0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.156717:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863730.156735:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226566784:0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.156767:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863730.156780:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226567296:0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.156798:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863730.156813:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788863730.156819:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5439fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226566400:0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.156839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863730.156858:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226566912:0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.156893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863730.156915:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567168 00000100:00100000:1.0:1788863730.156923:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567168 00000100:00100000:2.0:1788863730.156927:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226567040:0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.156955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863730.157672:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566144 00000100:00100000:0.0:1788863730.157678:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566144 00000100:00100000:0.0:1788863730.157728:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788863730.157737:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226566144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863730.157833:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226566144:12345-0@lo:400:kworker.0 Request processed in 97us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863730.157840:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788863730.157874:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566272 00000100:00100000:0.0:1788863730.157878:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566272 00000100:00100000:3.0:1788863730.157901:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226566144:0@lo:400:kworker.0 00000100:00100000:0.0:1788863730.157905:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566784 00000100:00100000:0.0:1788863730.157908:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566784 00000100:00100000:0.0:1788863730.157932:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567296 00000100:00100000:0.0:1788863730.157935:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567296 00000100:00100000:0.0:1788863730.157945:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566528 00000100:00100000:0.0:1788863730.157947:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566528 00000100:00100000:0.0:1788863730.157958:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788863730.157963:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226566272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863730.157994:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226566272:12345-0@lo:400:kworker.0 Request processed in 31us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863730.158000:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788863730.158010:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788863730.158016:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226566784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863730.158039:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226566784:12345-0@lo:400:kworker.0 Request processed in 24us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863730.158044:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788863730.158202:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566656 00000100:00100000:3.0:1788863730.158207:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566656 00000100:00100000:2.0:1788863730.158219:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226567552:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.158239:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566400 00000100:00100000:3.0:1788863730.158244:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566400 00000100:00100000:3.0:1788863730.158262:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788863730.158269:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863730.158273:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226566656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863730.158313:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788863730.158326:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226567296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.158346:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226566656:12345-0@lo:400:kworker.0 Request processed in 75us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863730.158355:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788863730.158368:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226567296:12345-0@lo:400:kworker.0 Request processed in 47us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863730.158377:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788863730.158378:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788863730.158390:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226566400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863730.158400:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788863730.158418:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226566528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.158429:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226566400:12345-0@lo:400:kworker.0 Request processed in 41us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863730.158436:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788863730.158456:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226566528:12345-0@lo:400:kworker.0 Request processed in 41us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863730.158463:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788863730.158575:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567680 00000100:00100000:1.0:1788863730.158580:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567680 00000100:00100000:1.0:1788863730.158604:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567040 00000100:00100000:1.0:1788863730.158606:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567040 00000100:00100000:1.0:1788863730.158621:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788863730.158627:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226567168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.158663:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226567168:12345-0@lo:400:kworker.0 Request processed in 36us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863730.158668:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788863730.158681:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788863730.158687:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226567680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.158714:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226567680:12345-0@lo:400:kworker.0 Request processed in 28us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863730.158719:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788863730.158729:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788863730.158735:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226567040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.158762:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226567040:12345-0@lo:400:kworker.0 Request processed in 26us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863730.158768:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788863730.159060:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567552 00000100:00100000:1.0:1788863730.159072:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567552 00000100:00100000:3.0:1788863730.159131:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226566656:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.159241:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226567168:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.159253:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788863730.159257:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e67f89aa00, transno 4294967305 00000100:00100000:3.0:1788863730.159266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226567680:0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.159391:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226566528:0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.159411:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226567040:0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.159442:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788863730.159449:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226567552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.159450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863730.159482:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226567424:0@lo:400:kworker.0 00000100:00100000:1.0:1788863730.159489:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226567552:12345-0@lo:400:kworker.0 Request processed in 41us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863730.159503:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788863730.159507:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226566912 00000100:00100000:3.0:1788863730.159512:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226566912 00000100:00100000:2.0:1788863730.159534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863730.160045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863730.160320:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567424 00000100:00100000:3.0:1788863730.160326:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567424 00000100:00100000:2.0:1788863730.160346:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226566272:0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.160363:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226566784:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.160367:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788863730.160378:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226566912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.160380:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226567296:0@lo:400:kworker.0 00000100:00100000:2.0:1788863730.160413:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5439fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226566400:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.160429:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226566912:12345-0@lo:400:kworker.0 Request processed in 52us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863730.160436:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788863730.160451:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788863730.160458:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226567424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.160485:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226567424:12345-0@lo:400:kworker.0 Request processed in 29us (952us total) trans 0 rc 0/0 00010000:00080000:2.0:1788863730.160501:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67f899f80 x1875759226566912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863730.160505:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788863730.160579:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226566912:0@lo:400:kworker.0 00010000:00080000:2.0:1788863730.160594:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67f898700 x1875759226567424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863730.160602:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226567424:0@lo:400:kworker.0 00000100:00080000:2.0:1788863730.160626:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863730.160631:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863730.160633:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863730.160760:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521792 00000100:00100000:2.0:1788863730.160765:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521792 00000100:00100000:2.0:1788863730.160803:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 389 00000100:00100000:2.0:1788863730.160808:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205521792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863730.160849:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205521792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 40us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863730.160856:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 389 00000100:00100000:2.0:1788863730.160883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863730.160924:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226567552:0@lo:400:kworker.0 00000100:00100000:3.0:1788863730.161151:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205522048 00000100:00100000:3.0:1788863730.161157:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205522048 00000100:00100000:2.0:1788863730.161158:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863730.161194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863730.161214:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205522304 00000100:00100000:2.0:1788863730.161221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863730.161221:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205522304 00000100:00100000:2.0:1788863730.161245:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863730.161271:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863730.161288:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205522560 00000100:00100000:2.0:1788863730.161291:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205522560 00000100:00100000:3.0:1788863730.161380:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205521920 00000100:00100000:3.0:1788863730.161384:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205521920 00000100:00100000:0.0:1788863730.161454:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205522176 00000100:00100000:0.0:1788863730.161458:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205522176 00000100:00080000:1.0:1788863730.161467:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863730.161471:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863730.161473:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863730.161475:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863730.161481:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:1.0:1788863730.161488:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205522432 00000100:00100000:0.0:1788863730.161491:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205522304:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863730.161492:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205522432 00000100:00100000:2.0:1788863730.161497:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 329 00000100:00100000:2.0:1788863730.161520:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205522048:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863730.161534:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 330 00000100:00100000:0.0:1788863730.161534:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205522304:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863730.161541:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:1.0:1788863730.161543:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205522560:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863730.161555:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:2.0:1788863730.161558:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205522048:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 51us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863730.161566:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205522176:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863730.161572:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 329 00000100:00100000:1.0:1788863730.161577:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205522560:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863730.161586:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 330 00000100:00100000:0.0:1788863730.161591:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205522176:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863730.161599:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 331 00000100:00100000:0.0:1788863730.161600:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:2.0:1788863730.161614:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205522432:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:1.0:1788863730.161614:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863730.161657:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2409:x1875759205522432:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863730.161664:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 331 00000100:00100000:2.0:1788863730.161682:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 332 00000100:00100000:2.0:1788863730.161691:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:2409:x1875759205521920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863730.161729:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:2409:x1875759205521920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863730.161735:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 332 00000100:00100000:3.0:1788863730.667815:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226567808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863730.667924:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863730.668005:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567808 00000100:00100000:2.0:1788863730.668016:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567808 00000100:00100000:3.0:1788863730.668027:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863730.668036:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863730.668113:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788863730.668133:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863730.668160:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226567808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863730.668194:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863730.668285:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226567808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863730.668292:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788863730.668308:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226567936 00000100:00100000:2.0:1788863730.668312:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226567936 00000100:00100000:2.0:1788863730.668326:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788863730.668332:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226567936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863730.668342:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863730.668369:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226567936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863730.668376:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788863730.668604:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863730.668621:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226567808:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788863730.861723:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863731.105194:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863731.105632:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205522688 00000100:00100000:3.0:1788863731.105643:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205522688 00000100:00100000:3.0:1788863731.106118:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 147 00000100:00100000:3.0:1788863731.106130:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:11092:x1875759205522688:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788863731.106245:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:11092:x1875759205522688:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 Request processed in 117us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863731.106254:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 147 00000100:00100000:2.0:1788863731.124200:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863731.124293:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205522816 00000100:00100000:0.0:1788863731.124304:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205522816 00000100:00100000:0.0:1788863731.124362:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 148 00000100:00100000:0.0:1788863731.124373:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:11092:x1875759205522816:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788863731.124510:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:11092:x1875759205522816:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 Request processed in 138us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863731.124537:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 148 00000100:00100000:0.0:1788863731.129760:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863731.129955:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523072 00000100:00100000:3.0:1788863731.129968:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523072 00000100:00100000:3.0:1788863731.130044:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:3.0:1788863731.130057:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:11092:x1875759205523072:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788863731.130627:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:11092:x1875759205523072:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 571us (876us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788863731.130653:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:0.0:1788863731.179501:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226568064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863731.179575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863731.179708:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568064 00000100:00100000:2.0:1788863731.179716:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568064 00000100:00100000:2.0:1788863731.179782:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788863731.179791:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226568064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863731.179826:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788863731.179876:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226568064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863731.179883:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788863731.179938:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226568064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863731.180488:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226568192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863731.180528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863731.180610:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568192 00000100:00100000:3.0:1788863731.180615:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568192 00000100:00100000:3.0:1788863731.180651:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788863731.180658:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226568192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863731.180679:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788863731.180733:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226568192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863731.180740:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788863731.180984:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226568192:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788863731.884233:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863732.911177:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788863733.747196:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788863733.747213:0:6516:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788863733.747260:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788863733.747286:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788863733.932716:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863734.653419:0:14478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:35:32 (1788863732) 00000100:00100000:0.0:1788863734.763524:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863734.763596:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226568320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863734.763680:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863734.767284:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226568448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863734.767355:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863734.767423:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568320 00000100:00100000:3.0:1788863734.767430:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568320 00000100:00100000:3.0:1788863734.767469:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568448 00000100:00100000:3.0:1788863734.767471:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568448 00000100:00100000:3.0:1788863734.767486:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863734.767494:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226568320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863734.767522:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788863734.767563:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226568320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (3884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863734.767570:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863734.767584:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788863734.767590:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226568448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863734.767599:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788863734.767628:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226568448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863734.767633:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788863734.767671:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226568448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863734.767689:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226568320:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788863734.767784:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788863734.891434:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863734.891442:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863734.891571:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788863734.891577:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788863734.891871:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788863734.955261:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863735.276841:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226568832:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277173:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226569344:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277265:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226569856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277323:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863735.277329:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226568960:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277373:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226569472:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277408:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277428:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226569984:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277480:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569344 00000100:00100000:3.0:1788863735.277486:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569344 00000100:00100000:3.0:1788863735.277529:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569856 00000100:00100000:3.0:1788863735.277531:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569856 00000100:00100000:3.0:1788863735.277549:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568960 00000100:00100000:3.0:1788863735.277551:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568960 00000100:00100000:1.0:1788863735.277578:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226568704:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277588:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788863735.277597:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226569344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.277641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863735.277662:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226569216:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277663:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226569344:12345-0@lo:400:kworker.0 Request processed in 65us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.277675:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788863735.277691:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277692:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568704 00000100:00100000:3.0:1788863735.277697:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568704 00000100:00100000:1.0:1788863735.277707:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226569728:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277712:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569216 00000100:00100000:3.0:1788863735.277717:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569216 00000100:00100000:3.0:1788863735.277739:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788863735.277749:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226569856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.277750:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863735.277789:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788863735.277797:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226568576:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277802:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226569856:12345-0@lo:400:kworker.0 Request processed in 55us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.277810:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788863735.277822:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569728 00000100:00100000:3.0:1788863735.277825:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569728 00000100:00100000:1.0:1788863735.277839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277852:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788863735.277859:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226568960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.277868:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226569088:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277899:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226568960:12345-0@lo:400:kworker.0 Request processed in 39us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.277907:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788863735.277917:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.277921:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788863735.277929:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226568704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.277941:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226569600:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.277974:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226568704:12345-0@lo:400:kworker.0 Request processed in 46us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.277981:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788863735.277996:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788863735.277999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.278012:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226569216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.278020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226570112:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.278056:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226569216:12345-0@lo:400:kworker.0 Request processed in 44us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863735.278057:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863735.278067:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788863735.278110:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788863735.278119:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226569728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.278124:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226568704:0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.278139:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226569216:0@lo:400:kworker.0 00000100:00100000:2.0:1788863735.278231:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569472 00000100:00100000:2.0:1788863735.278237:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569472 00000100:00100000:2.0:1788863735.278257:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569984 00000100:00100000:2.0:1788863735.278260:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569984 00000100:00100000:2.0:1788863735.278274:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569600 00000100:00100000:2.0:1788863735.278277:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569600 00000100:00100000:2.0:1788863735.278286:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226570112 00000100:00100000:2.0:1788863735.278288:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226570112 00000100:00100000:2.0:1788863735.278300:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788863735.278306:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226569472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863735.278398:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788863735.278407:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226569984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.287782:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226569728:12345-0@lo:400:kworker.0 Request processed in 9655us (10026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.287799:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788863735.287866:0:8451:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788863735.287875:0:8451:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:3.0:1788863735.287897:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863735.287903:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863735.287906:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863735.287919:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568832 00000100:00100000:3.0:1788863735.287927:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568832 00000100:00100000:3.0:1788863735.287982:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226569088 00000100:00100000:3.0:1788863735.287986:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226569088 00000100:00100000:3.0:1788863735.288002:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788863735.288010:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226568832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288105:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226568832:12345-0@lo:400:kworker.0 Request processed in 95us (11029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.288111:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788863735.288124:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788863735.288130:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226569088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288163:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226569088:12345-0@lo:400:kworker.0 Request processed in 34us (10261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.288185:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788863735.288231:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226568960:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288245:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226568832:0@lo:400:kworker.0 00010000:00080000:3.0:1788863735.288262:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438d5880 x1875759226569344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863735.288273:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226569344:0@lo:400:kworker.0 00010000:00080000:3.0:1788863735.288285:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e676155500 x1875759226569856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863735.288293:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e676155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226569856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288486:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226569088:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288499:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226569728:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288613:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788863735.288622:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226569600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288664:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226569600:12345-0@lo:400:kworker.0 Request processed in 45us (10669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.288669:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788863735.288683:0:8451:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788863735.288689:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788863735.288696:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226570112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288722:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226570112:12345-0@lo:400:kworker.0 Request processed in 28us (10669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.288726:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788863735.288759:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226569600:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288769:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226570112:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288884:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226568576 00000100:00100000:3.0:1788863735.288890:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226568576 00000100:00100000:3.0:1788863735.288931:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788863735.288938:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226568576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.288984:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226568576:12345-0@lo:400:kworker.0 Request processed in 47us (11151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863735.288991:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788863735.289027:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226568576:0@lo:400:kworker.0 00000100:00100000:2.0:1788863735.292609:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226569472:12345-0@lo:400:kworker.0 Request processed in 14284us (15180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863735.292626:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788863735.293798:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226569984:12345-0@lo:400:kworker.0 Request processed in 15386us (16344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863735.293810:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788863735.294029:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863735.294161:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863735.294197:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863735.294221:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523584 00000100:00100000:0.0:1788863735.294230:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523584 00000100:00100000:0.0:1788863735.294281:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00100000:0.0:1788863735.294291:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205523584:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863735.294293:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523328 00000100:00100000:1.0:1788863735.294300:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523328 00000100:00100000:1.0:1788863735.294339:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 339 00000100:00100000:1.0:1788863735.294348:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:2411:x1875759205523328:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863735.294369:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205523584:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 78us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863735.294377:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00080000:0.0:1788863735.294395:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863735.294400:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863735.294467:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523200 00000100:00100000:2.0:1788863735.294471:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523200 00000100:00100000:2.0:1788863735.294553:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 391 00000100:00100000:2.0:1788863735.294562:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205523200:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863735.295652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863735.295803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863735.295833:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863735.295863:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863735.295892:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523712 00000100:00100000:0.0:1788863735.295898:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523712 00000100:00100000:0.0:1788863735.295945:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:0.0:1788863735.295979:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205523712:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863735.296848:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205523712:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 867us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863735.296858:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:0.0:1788863735.297387:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523840 00000100:00100000:0.0:1788863735.297395:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523840 00000100:00100000:0.0:1788863735.297428:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523456 00000100:00100000:0.0:1788863735.297431:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523456 00000100:00100000:0.0:1788863735.297445:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205523968 00000100:00100000:0.0:1788863735.297448:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205523968 00000100:00100000:0.0:1788863735.297463:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 340 00000100:00100000:0.0:1788863735.297470:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205523840:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863735.297783:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205523840:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 307us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863735.297791:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 340 00000100:00100000:0.0:1788863735.297806:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 341 00000100:00100000:0.0:1788863735.297814:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205523456:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863735.297848:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205523456:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 30us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863735.297854:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 341 00000100:00100000:0.0:1788863735.297867:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 342 00000100:00100000:0.0:1788863735.297874:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205523968:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863735.298018:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205523968:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 144us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863735.298024:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 342 00000100:00080000:0.0:1788863735.298065:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863735.298069:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863735.298072:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863735.302774:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226569472:0@lo:400:kworker.0 00000100:00100000:3.0:1788863735.302796:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226569984:0@lo:400:kworker.0 00000100:00100000:2.0:1788863735.306659:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205523200:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 12085us (12619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863735.306675:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 391 00000100:00100000:1.0:1788863735.307554:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:2411:x1875759205523328:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 13199us (13384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863735.307566:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 339 00000100:00100000:3.0:1788863735.787770:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226570240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863735.787780:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863735.787799:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226570368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863735.787898:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863735.788133:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226570240 00000100:00100000:2.0:1788863735.788155:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226570240 00000100:00100000:2.0:1788863735.788218:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788863735.788227:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226570240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863735.788262:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863735.788315:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226570240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863735.788322:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788863735.788347:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863735.788371:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226570368 00000100:00100000:2.0:1788863735.788375:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226570368 00000100:00100000:2.0:1788863735.788391:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788863735.788397:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226570368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863735.788407:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863735.788435:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226570368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863735.788442:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788863735.788496:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226570368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863735.788532:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226570240:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788863735.980364:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863736.220701:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863736.220895:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205524224 00000100:00100000:0.0:1788863736.220910:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205524224 00000100:00100000:0.0:1788863736.221001:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 149 00000100:00100000:0.0:1788863736.221012:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:12150:x1875759205524224:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863736.221036:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863736.221059:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69710 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518807f expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221182:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221199:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221212:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221269:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221278:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221285:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221416:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69725 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221527:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69725 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221536:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69725 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863736.221548:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788863736.221646:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221655:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221664:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221685:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863736.221690:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221698:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221711:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e643aa2500) 00010000:00010000:0.0:1788863736.221714:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863736.221721:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221728:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69717 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221744:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221758:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221763:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221768:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863736.221772:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221778:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221787:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89e681a6aa00) 00010000:00010000:0.0:1788863736.221790:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863736.221793:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.221800:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6971e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.222167:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69710 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518807f expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.222183:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69725 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518807f expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863736.222190:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:0.0:1788863736.222193:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863736.222202:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a800, rc 0) 00000100:00100000:0.0:1788863736.222284:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:12150:x1875759205524224:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 1274us (1597us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788863736.222293:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 149 00000100:00100000:0.0:1788863736.229044:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863736.229125:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863736.229243:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205524352 00000100:00100000:1.0:1788863736.229258:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205524352 00000100:00100000:1.0:1788863736.229323:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 150 00000100:00100000:1.0:1788863736.229335:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:12150:x1875759205524352:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788863736.230795:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:12150:x1875759205524352:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 1452us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863736.230807:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 150 00000100:00100000:2.0:1788863736.237490:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205524480 00000100:00100000:2.0:1788863736.237505:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205524480 00000100:00100000:2.0:1788863736.237569:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1788863736.237575:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:2411:x1875759205524480:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863736.237587:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863736.237623:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69725 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518807f expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863736.237662:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:2.0:1788863736.237673:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863736.238496:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863736.241122:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205524608 00000100:00100000:1.0:1788863736.241137:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205524608 00000100:00100000:1.0:1788863736.241210:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 151 00000100:00100000:1.0:1788863736.241220:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:12150:x1875759205524608:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788863736.241333:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:12150:x1875759205524608:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 114us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863736.241340:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 151 00000100:00100000:2.0:1788863736.249163:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:2411:x1875759205524480:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 11572us (20022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863736.249180:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1788863736.299489:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863736.299514:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226570496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863736.299586:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863736.300249:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226570624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863736.300287:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863736.300373:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226570496 00000100:00100000:0.0:1788863736.300381:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226570496 00000100:00100000:0.0:1788863736.300428:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226570624 00000100:00100000:0.0:1788863736.300431:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226570624 00000100:00100000:0.0:1788863736.300447:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788863736.300455:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226570496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863736.300487:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863736.300532:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226570496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863736.300538:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788863736.300554:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788863736.300559:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226570624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863736.300576:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788863736.300617:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226570624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863736.300623:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788863736.301005:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226570624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863736.302656:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226570496:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788863736.939725:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863736.939735:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863736.940333:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788863736.940359:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788863736.942265:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788863737.004277:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863738.028536:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863738.570815:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863738.571301:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205524736 00000100:00100000:2.0:1788863738.571315:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205524736 00000100:00100000:2.0:1788863738.571416:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:2.0:1788863738.571428:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:12193:x1875759205524736:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863738.571456:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863738.571683:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188086 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788863738.571713:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788863738.571772:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571790:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571805:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571822:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571846:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571854:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571914:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571923:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571929:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571951:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863738.571956:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.571964:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572214:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:2.0:1788863738.572218:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863738.572226:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572233:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b6973a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572263:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572284:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572291:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572295:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863738.572298:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572305:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572313:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89e542bf2300) 00010000:00010000:2.0:1788863738.572316:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863738.572319:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572325:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572363:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69733 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188086 expref: 15 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572374:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:2.0:1788863738.572376:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863738.572796:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188086 expref: 15 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.572819:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98600, rc 0) 00000100:00100000:2.0:1788863738.572914:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:12193:x1875759205524736:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1487us (2115us total) trans 0 rc 301/301 00000100:00100000:2.0:1788863738.572923:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:1.0:1788863738.603752:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863738.603823:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205524992 00000100:00100000:1.0:1788863738.603838:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205524992 00000100:00100000:1.0:1788863738.603919:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 153 00000100:00100000:1.0:1788863738.603931:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+14:12193:x1875759205524992:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:1.0:1788863738.606466:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863738.606540:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eb1 expref: 14 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.606570:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2800) 00010000:00010000:1.0:1788863738.606800:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863738.606914:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.606932:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.606945:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.606960:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.606967:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.606972:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608072:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608137:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608327:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863738.608349:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4bd2ebf reply state 0000000043c5c9aa transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608369:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608377:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863738.608380:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863738.608385:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788863738.608391:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788863738.608399:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608407:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608413:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608419:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863738.608424:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608432:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608441:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:1.0:1788863738.608444:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863738.608447:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608453:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b69748 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863738.608484:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4bd2ebf reply state 0000000043c5c9aa transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608493:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.608499:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89e643aa2300) 00010000:00010000:1.0:1788863738.608502:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863738.608504:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788863738.608693:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:12193:x1875759205524992:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 4759us (4950us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788863738.608702:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 153 00000100:00100000:2.0:1788863738.812495:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863738.812694:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205525120 00000100:00100000:1.0:1788863738.812712:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205525120 00000100:00100000:1.0:1788863738.812813:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 154 00000100:00100000:1.0:1788863738.812825:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+15:12201:x1875759205525120:12345-192.168.204.35@tcp:101:lctl.0 00010000:00010000:1.0:1788863738.812862:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863738.812907:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6975d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518808d expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.813013:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.813031:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.813047:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863738.813156:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788863738.813161:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863738.813189:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.813220:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6975d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518808d expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.813246:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518808d expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.813256:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:1.0:1788863738.813260:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863738.813264:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fe00, rc 0) 00000100:00100000:1.0:1788863738.813342:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:12201:x1875759205525120:12345-192.168.204.35@tcp:101:lctl.0 Request processed in 519us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863738.813350:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 154 00000100:00100000:1.0:1788863738.928819:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863738.931042:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205525248 00000100:00100000:2.0:1788863738.931069:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205525248 00000100:00100000:2.0:1788863738.931236:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 155 00000100:00100000:2.0:1788863738.931249:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+16:12207:x1875759205525248:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788863738.931291:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863738.931319:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6976b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188094 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.931599:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.931619:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.931637:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.931650:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.931658:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.931693:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.932953:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69780 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.933105:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.933125:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863738.933202:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788863738.933207:0:12972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863738.933237:0:12972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.933256:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934634:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934664:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934672:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863738.934678:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934690:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934739:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:2.0:1788863738.934742:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863738.934749:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934757:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934781:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934788:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934793:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934812:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863738.934815:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934820:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934830:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89e643aa2300) 00010000:00010000:2.0:1788863738.934832:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863738.934836:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.934841:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69779 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.937511:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6976b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188094 expref: 18 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.937560:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188094 expref: 17 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.937572:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863738.937576:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788863738.937581:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:2.0:1788863738.937705:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:12207:x1875759205525248:12345-192.168.204.35@tcp:101:bash.0 Request processed in 6456us (8909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863738.937717:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 155 00000100:00100000:0.0:1788863738.945847:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863738.946031:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205525504 00000100:00100000:2.0:1788863738.946042:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205525504 00000100:00100000:2.0:1788863738.946142:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 156 00000100:00100000:2.0:1788863738.946167:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+17:12207:x1875759205525504:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788863738.946196:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863738.946221:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b69787 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518809b expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.946373:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.946390:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.946404:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.946440:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.946448:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.946456:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863738.946804:0:10368:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788863738.946989:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.946999:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.947006:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.947039:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.947047:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.947054:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.947060:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863738.947065:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.948496:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.948517:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863738.948520:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863738.948526:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.948533:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b6978e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863738.948553:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021862f26 reply state 00000000df0119c3 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.948565:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863738.948572:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e542bf2300) 00010000:00010000:2.0:1788863738.948574:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863738.948577:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788863738.949712:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b69787 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 20 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863738.949739:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 19 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863738.949749:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e542bf2d00) 00010000:00010000:3.0:1788863738.949751:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863738.949771:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167cc00, rc 0) 00000100:00100000:3.0:1788863738.949967:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:12207:x1875759205525504:12345-192.168.204.35@tcp:101:bash.0 Request processed in 3802us (4140us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788863738.949977:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 156 00000100:00100000:3.0:1788863738.961216:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863738.961729:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205525632 00000100:00100000:1.0:1788863738.961745:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205525632 00000100:00100000:1.0:1788863738.961858:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:1.0:1788863738.961872:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2409:x1875759205525632:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863738.961911:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863738.961941:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880a2 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788863738.961978:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863738.962025:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1788863738.962030:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863738.962042:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 6 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.962069:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 6 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.962114:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e400, rc 0) 00000100:00100000:1.0:1788863738.962203:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205525632:12345-192.168.204.35@tcp:101:bash.0 Request processed in 334us (1012us total) trans 0 rc 0/0 00000100:00080000:0.0:1788863738.962320:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863738.962475:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:0.0:1788863738.987633:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863738.989552:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205525760 00000100:00100000:1.0:1788863738.989572:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205525760 00000100:00100000:1.0:1788863738.989669:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:1.0:1788863738.989682:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:12207:x1875759205525760:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863738.989708:0:8606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863738.989734:0:8606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880a9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.989791:0:8606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.990011:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863738.990016:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863738.990023:0:8606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 7 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.990128:0:8606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863738.990147:0:8606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 7 pid: 8452 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863738.990165:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8606:1875759226570752:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863738.990658:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863739.001201:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8606:1875759226570752:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863739.001500:0:8606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 7 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.001531:0:8606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863739.001702:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:12207:x1875759205525760:12345-192.168.204.35@tcp:101:bash.0 Request processed in 12020us (14085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863739.001714:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:3.0:1788863739.003447:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.008853:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205525888 00000100:00100000:1.0:1788863739.008893:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205525888 00010000:00010000:1.0:1788863739.008977:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 7 pid: 8452 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863739.009040:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:1.0:1788863739.009051:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205525888:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863739.009151:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863739.009181:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 7 pid: 8452 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.009199:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 7 pid: 8452 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.009234:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b697aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a2 expref: 7 pid: 8452 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.009257:0:10356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863739.009274:0:10356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863739.009286:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 6 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.009308:0:10356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 6 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.009364:0:10356:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 6 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863739.009383:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10356:1875759226570880:192.168.204.35@tcp:105: 00000100:00100000:1.0:1788863739.009514:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863739.015051:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10356:1875759226570880:192.168.204.35@tcp:105: 00010000:00010000:3.0:1788863739.015129:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863739.015246:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2408:x1875759205525888:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 6193us (11810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863739.015260:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:0.0:1788863739.018406:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863739.018639:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205526144 00000100:00100000:3.0:1788863739.018654:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205526144 00000100:00100000:3.0:1788863739.018731:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:3.0:1788863739.018743:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:12207:x1875759205526144:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:3.0:1788863739.019229:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12207:x1875759205526144:12345-192.168.204.35@tcp:35:bash.0 Request processed in 486us (836us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788863739.019240:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 36 00010000:00010000:1.0:1788863739.051650:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863739.121452:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863739.121607:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205526400 00000100:00100000:3.0:1788863739.121617:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205526400 00000100:00100000:3.0:1788863739.121756:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 157 00000100:00100000:3.0:1788863739.121776:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12217:x1875759205526400:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863739.121806:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863739.121829:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b697b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880b0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863739.121961:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788863739.122125:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b697b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880b0 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.122139:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:3.0:1788863739.122143:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863739.122148:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b697b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880b0 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.122163:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031400, rc 0) 00000100:00100000:3.0:1788863739.122216:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:12217:x1875759205526400:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 444us (775us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788863739.122223:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 157 00000100:00100000:2.0:1788863739.126162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863739.126384:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205526656 00000100:00100000:3.0:1788863739.126394:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205526656 00000100:00100000:3.0:1788863739.126443:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:3.0:1788863739.126452:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:12217:x1875759205526656:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788863739.126678:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:12217:x1875759205526656:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 227us (523us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788863739.126685:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:0.0:1788863739.205393:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863739.205691:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205526784 00000100:00100000:2.0:1788863739.205703:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205526784 00000100:00100000:2.0:1788863739.205768:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 158 00000100:00100000:2.0:1788863739.205779:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:12223:x1875759205526784:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863739.205808:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863739.205830:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b697c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880b7 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.205934:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b697cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.205949:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b697cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.205961:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b697cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863739.206008:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788863739.206012:0:12972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863739.206033:0:12972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b697cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.206061:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b697c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880b7 expref: 25 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.206120:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b697cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880b7 expref: 24 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.206129:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863739.206133:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863739.206137:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167c200, rc 0) 00000100:00100000:2.0:1788863739.211326:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:12223:x1875759205526784:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 5533us (5927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863739.211341:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 158 00000100:00100000:2.0:1788863739.217578:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863739.218257:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205527040 00000100:00100000:3.0:1788863739.218271:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205527040 00000100:00100000:3.0:1788863739.218338:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 159 00000100:00100000:3.0:1788863739.218350:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:12223:x1875759205527040:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863739.218375:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863739.218444:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b697d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880be expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.218592:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b697db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.218609:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b697db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.218623:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b697db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863739.218634:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788863739.218761:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b697d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880be expref: 27 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.218780:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b697db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880be expref: 26 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.218789:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e542bf2d00) 00010000:00010000:3.0:1788863739.218792:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863739.218795:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030800, rc 0) 00000100:00100000:3.0:1788863739.218944:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12223:x1875759205527040:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 595us (1380us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788863739.218952:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 159 00000100:00100000:3.0:1788863739.235000:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.235415:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205527296 00000100:00100000:1.0:1788863739.235427:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205527296 00000100:00100000:1.0:1788863739.235867:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 160 00000100:00100000:1.0:1788863739.235889:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12223:x1875759205527296:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863739.235919:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863739.235942:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b697e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880c5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.236047:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b697f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.236063:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b697f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.236120:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b697f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863739.236135:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788863739.236700:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b697e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880c5 expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.236721:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b697f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880c5 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.236731:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e542bf2d00) 00010000:00010000:1.0:1788863739.236734:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863739.236737:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fa00, rc 0) 00000100:00100000:0.0:1788863739.237951:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:12223:x1875759205527296:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 2059us (2956us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788863739.237963:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 160 00000100:00100000:2.0:1788863739.253947:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863739.255044:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205527424 00000100:00100000:3.0:1788863739.255058:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205527424 00000100:00100000:3.0:1788863739.255160:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:3.0:1788863739.255171:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:2411:x1875759205527424:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863739.255197:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863739.255226:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b697db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880be expref: 28 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.255249:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e542bf2d00) 00010000:00010000:3.0:1788863739.255254:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863739.255326:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:2411:x1875759205527424:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 157us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863739.255333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:1.0:1788863739.269177:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863739.269263:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205527552 00000100:00100000:3.0:1788863739.269274:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205527552 00000100:00100000:3.0:1788863739.269345:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:3.0:1788863739.269356:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2409:x1875759205527552:12345-192.168.204.35@tcp:1:lfs.0 00010000:00010000:3.0:1788863739.269420:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.269565:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 6 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.269576:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863739.269580:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863739.269585:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.269626:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 6 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.269663:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 6 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863739.269681:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14490:1875759226571008:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863739.269776:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863739.276184:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14490:1875759226571008:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863739.276218:0:14490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863739.281523:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863739.281858:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205527680 00000100:00100000:0.0:1788863739.281882:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205527680 00002000:00100000:0.0:1788863739.281946:0:8456:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff89e681ca9c00 x1875759205527680/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:725/0 lens 504/0 e 0 to 0 dl 1788863750 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863739.281959:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e681ca9c00 with x1875759205527680 ext(0->12) 00010000:00010000:0.0:1788863739.281970:0:8456:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 7 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.281990:0:8456:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 7 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863739.281998:0:8456:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89e681ca9c00 00000100:00100000:0.0:1788863739.282041:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1788863739.282050:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205527680:12345-192.168.204.35@tcp:4:lfs.0 00000100:00100000:0.0:1788863739.284881:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205527680:12345-192.168.204.35@tcp:4:lfs.0 Request processed in 2809us (3349us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788863739.284904:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00002000:00100000:0.0:1788863739.284937:0:8456:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff89e681ca9c00 x1875759205527680/t4294967306(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:725/0 lens 504/448 e 0 to 0 dl 1788863750 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863739.284947:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e681ca9c00 with x1875759205527680 ext(0->12) 00010000:00010000:0.0:1788863739.284959:0:8456:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 9 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.284979:0:8456:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 9 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863739.284986:0:8456:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89e681ca9c00 00000100:00100000:2.0:1788863739.296265:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.296607:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205527808 00000100:00100000:1.0:1788863739.296618:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205527808 00010000:00010000:1.0:1788863739.296657:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 9 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863739.296726:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:1.0:1788863739.296737:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2410:x1875759205527808:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863739.296767:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788863739.296787:0:10355:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788863739.296790:0:10355:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788863739 00002000:00010000:1.0:1788863739.296792:0:10355:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788863739 00002000:00010000:1.0:1788863739.296794:0:10355:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788863739 00002000:00010000:1.0:1788863739.296796:0:10355:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788863739.296803:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 9 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.296817:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 9 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.296840:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b697b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880a9 expref: 9 pid: 8606 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.296857:0:10355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863739.296861:0:10355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863739.296878:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.296888:0:10355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.296944:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863739.297016:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2410:x1875759205527808:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 280us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863739.297025:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 79 00010000:00010000:0.0:1788863739.299654:0:14490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299676:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299712:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299722:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299732:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299741:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863739.299779:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299791:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299812:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.299821:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b697fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863739.299959:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205527552:12345-192.168.204.35@tcp:1:lfs.0 Request processed in 30600us (30790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863739.299971:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:2.0:1788863739.308538:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863739.308683:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205528064 00000100:00100000:3.0:1788863739.308693:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205528064 00000100:00100000:3.0:1788863739.308761:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:3.0:1788863739.308778:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bd9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12223:x1875759205528064:12345-192.168.204.35@tcp:35:lfs.0 00000004:00010000:3.0:1788863739.308849:0:6540:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b697f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880c5 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863739.309138:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788863739.309174:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788863739.309512:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788863739.309553:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.309569:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 31 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.309593:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.309635:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 31 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863739.309650:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 31 pid: 10368 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863739.309666:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6540:1875759226571136:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863739.309764:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863739.319967:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.320072:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205528192 00000100:00100000:1.0:1788863739.320123:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205528192 00010000:00010000:1.0:1788863739.320172:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 32 pid: 10368 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863739.320212:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:0.0:1788863739.320222:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6540:1875759226571136:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863739.320224:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:2409:x1875759205528192:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863739.320245:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863739.320253:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 32 pid: 10368 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.320255:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.320278:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 32 pid: 10368 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.323898:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b6979c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518809b expref: 32 pid: 10368 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.323930:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e542bf2d00) 00010000:00010000:1.0:1788863739.323936:0:10356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.323946:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.323974:0:10356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.324021:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863739.324219:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+31:2409:x1875759205528192:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 3993us (4257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863739.324230:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 80 00010000:00010000:0.0:1788863739.324900:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.324912:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863739.325046:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1788863739.325221:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788863739.325343:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226571264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788863739.325449:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863739.325492:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863739.326893:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226571264 00000100:00100000:1.0:1788863739.326914:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226571264 00000100:00100000:1.0:1788863739.326983:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788863739.326994:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6540:x1875759226571264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788863739.327135:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6540:x1875759226571264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 142us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863739.327156:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1788863739.327336:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863739.327608:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226571264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788863739.327789:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788863739.327881:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544002a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226571392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788863739.327927:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863739.328015:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863739.336360:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226571392 00000100:00100000:3.0:1788863739.336535:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226571392 00000100:00100000:3.0:1788863739.336612:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788863739.336624:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6540:x1875759226571392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788863739.336893:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6540:x1875759226571392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 270us (8964us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788863739.336901:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788863739.342226:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544002a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226571392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788863739.342509:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788863739.342647:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.342659:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.342667:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.342672:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863739.342677:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.342684:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.342724:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e542bf2d00) 00010000:00010000:1.0:1788863739.342727:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788863739.342732:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.342738:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69805 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863739.342856:0:6540:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788863739.342935:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788863739.342947:0:6540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406466870049ns, next at 407466867632ns, rc = 0 00000001:00080000:1.0:1788863739.342953:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788863739.343034:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e542bf2d00) 00010000:00010000:1.0:1788863739.343037:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863739.343044:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b697f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880c5 expref: 35 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863739.343882:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bd9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:12223:x1875759205528064:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 35094us (35344us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788863739.343893:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 38 00000020:00080000:1.0:1788863739.343899:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788863739.348786:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863739.348855:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205528320 00000100:00100000:0.0:1788863739.348865:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205528320 00000100:00100000:0.0:1788863739.348947:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 161 00000100:00100000:0.0:1788863739.348966:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:12223:x1875759205528320:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863739.348992:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863739.349018:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b6980c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880cc expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.349118:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b6980c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880cc expref: 35 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.349142:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b6980c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880cc expref: 35 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.349161:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863739.349164:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863739.349168:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b400, rc 0) 00000100:00100000:0.0:1788863739.349244:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:12223:x1875759205528320:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 280us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863739.349252:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 161 00000100:00100000:2.0:1788863739.355489:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863739.355963:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205528576 00000100:00100000:0.0:1788863739.355975:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205528576 00000100:00100000:0.0:1788863739.356032:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:0.0:1788863739.356043:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:12223:x1875759205528576:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863739.356454:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:12223:x1875759205528576:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 410us (973us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788863739.356463:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:3.0:1788863739.524222:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.524471:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205528832 00000100:00100000:1.0:1788863739.524482:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205528832 00000100:00100000:1.0:1788863739.524553:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 162 00000100:00100000:1.0:1788863739.524563:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:12233:x1875759205528832:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863739.524603:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863739.524628:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69813 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880d3 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863739.524736:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788863739.524854:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69813 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880d3 expref: 38 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.524882:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:1.0:1788863739.524886:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863739.524892:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880d3 expref: 38 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.524909:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fa00, rc 0) 00000100:00100000:1.0:1788863739.524981:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12233:x1875759205528832:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 420us (770us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788863739.524989:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 162 00000100:00100000:3.0:1788863739.528658:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863739.531165:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205528960 00000100:00100000:0.0:1788863739.531183:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205528960 00000100:00100000:0.0:1788863739.531266:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 163 00000100:00100000:0.0:1788863739.531277:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12233:x1875759205528960:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:0.0:1788863739.531354:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531373:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531387:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531397:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531404:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531410:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531490:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531514:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531522:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863739.531574:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531586:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531593:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531599:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531604:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ac00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863739.531609:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531616:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531627:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863739.531630:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863739.531635:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531641:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69821 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531662:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531668:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531674:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531679:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259bc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863739.531682:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531689:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531698:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e542bf2300) 00010000:00010000:0.0:1788863739.531700:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863739.531703:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531708:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531718:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531724:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531729:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531740:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863739.531743:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531750:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531758:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863739.531761:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863739.531765:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863739.531771:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6982f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863739.531884:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12233:x1875759205528960:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 609us (3238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863739.531893:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 163 00000100:00100000:3.0:1788863739.547111:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.547413:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205529216 00000100:00100000:1.0:1788863739.547423:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205529216 00000100:00100000:1.0:1788863739.547481:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:1.0:1788863739.547490:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12233:x1875759205529216:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863739.547718:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12233:x1875759205529216:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 229us (666us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788863739.547726:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:3.0:1788863739.612347:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.612457:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205529472 00000100:00100000:1.0:1788863739.612470:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205529472 00000100:00100000:1.0:1788863739.612541:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 164 00000100:00100000:1.0:1788863739.612564:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12236:x1875759205529472:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863739.612595:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863739.612618:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69836 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880da expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612721:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612739:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612750:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612762:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612769:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612775:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612903:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612913:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.612920:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863739.612941:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788863739.613030:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613038:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613045:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613051:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863739.613055:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613062:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613119:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863739.613123:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863739.613127:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613133:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6983d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613306:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613313:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613328:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613333:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863739.613336:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613342:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613351:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e542bf2300) 00010000:00010000:1.0:1788863739.613353:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863739.613356:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863739.613362:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69844 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.613548:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69836 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.613564:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.613572:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:2.0:1788863739.613574:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863739.613576:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f200, rc 0) 00000100:00100000:2.0:1788863739.613637:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12236:x1875759205529472:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1078us (1299us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788863739.613645:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 164 00000100:00100000:0.0:1788863739.621223:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863739.621461:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205529600 00000100:00100000:2.0:1788863739.621472:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205529600 00000100:00100000:2.0:1788863739.621537:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 165 00000100:00100000:2.0:1788863739.621549:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12236:x1875759205529600:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:2.0:1788863739.621620:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621638:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621652:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621709:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621717:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621724:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621730:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863739.621735:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621744:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621757:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:2.0:1788863739.621760:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863739.621766:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863739.621771:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863739.622013:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12236:x1875759205529600:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 465us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863739.622021:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 165 00000100:00100000:3.0:1788863739.631742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863739.631841:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205529856 00000100:00100000:1.0:1788863739.631853:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205529856 00000100:00100000:1.0:1788863739.631924:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:1.0:1788863739.631934:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12236:x1875759205529856:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863739.632205:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12236:x1875759205529856:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 272us (474us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788863739.632213:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:1.0:1788863739.883452:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863739.883475:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226571648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863739.883548:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863739.883637:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226571648 00000100:00100000:1.0:1788863739.883645:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226571648 00000100:00100000:1.0:1788863739.883709:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788863739.883719:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226571648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863739.883753:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788863739.883808:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226571648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863739.883815:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788863739.883835:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863739.883876:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226571648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863739.884153:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863739.884165:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226571520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863739.884196:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863739.884316:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226571520 00000100:00100000:3.0:1788863739.884328:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226571520 00000100:00100000:3.0:1788863739.884361:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788863739.884367:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226571520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863739.884379:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788863739.884413:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226571520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863739.884419:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788863739.884453:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226571520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863739.884512:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863740.053821:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863740.056369:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205530112 00000100:00100000:0.0:1788863740.056385:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205530112 00000100:00100000:0.0:1788863740.056479:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00100000:0.0:1788863740.056492:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12267:x1875759205530112:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:0.0:1788863740.056522:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863740.056562:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69860 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880e1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.056674:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69867 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.056689:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.056705:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863740.056717:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788863740.056849:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69860 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e1 expref: 44 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.056880:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e1 expref: 43 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.056888:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863740.056891:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863740.056894:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a000, rc 0) 00000100:00100000:0.0:1788863740.056960:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+43:12267:x1875759205530112:12345-192.168.204.35@tcp:101:cat.0 Request processed in 470us (3148us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788863740.056968:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00080000:1.0:1788863740.057067:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788863740.060354:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:2.0:1788863740.060380:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788863740.060403:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e542906000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788863740.060417:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e542946b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e542906840 00000020:00080000:2.0:1788863740.060420:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e542946d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e6438d7400 00000100:00100000:3.0:1788863740.062557:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863740.062583:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226571776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788863740.062657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863740.062733:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226571776 00000100:00100000:3.0:1788863740.062741:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226571776 00000100:00100000:3.0:1788863740.062789:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863740.062798:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226571776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788863740.062825:0:8451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1788863740.062870:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fe4fb, atime: 0x6a9fe4fb, ctime: 0x6a9fe4fb, blocks: 0x8 00010000:00010000:3.0:1788863740.062879:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.062896:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1788863740.062901:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863740.062907:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.062924:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.062949:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.062958:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.062975:0:8451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788863740.063152:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1875759226571776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 355us (494us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788863740.063160:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:3.0:1788863740.063183:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863740.063188:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.063196:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863740.063200:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.063209:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.063226:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.063233:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f689b4a/0xf569beb9d4b69875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.063257:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863740.063260:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863740.063261:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788863740.063296:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e67f89a300/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788863740.063302:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226571776:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788863740.063337:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788863740.063370:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788863740.063688:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063698:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063716:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063721:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863740.063726:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063732:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063807:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89e643aa2300) 00010000:00010000:0.0:1788863740.063811:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863740.063815:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063821:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6974f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063841:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063848:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063864:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063869:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863740.063872:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063889:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063897:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863740.063900:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863740.063903:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063908:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69756 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063921:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063926:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063932:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063936:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863740.063938:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063943:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063949:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e542bf2300) 00010000:00010000:0.0:1788863740.063951:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863740.063954:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.063964:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69795 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863740.065245:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863740.065494:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863740.065580:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205530368 00000100:00100000:1.0:1788863740.065591:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205530368 00000100:00100000:1.0:1788863740.065658:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:1.0:1788863740.065669:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:12267:x1875759205530368:12345-192.168.204.35@tcp:35:cat.0 00000100:00100000:1.0:1788863740.065936:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:12267:x1875759205530368:12345-192.168.204.35@tcp:35:cat.0 Request processed in 268us (698us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788863740.065943:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:3.0:1788863740.068165:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205530496 00000100:00100000:3.0:1788863740.068181:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205530496 00000100:00100000:3.0:1788863740.068259:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:3.0:1788863740.068270:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:2411:x1875759205530496:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863740.068289:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863740.068315:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69867 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e1 expref: 19 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.068335:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:3.0:1788863740.068341:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863740.068392:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:2411:x1875759205530496:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 125us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863740.068400:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00010000:00010000:3.0:1788863740.075464:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863740.137888:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.138037:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205530752 00000100:00100000:2.0:1788863740.138047:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205530752 00000100:00100000:2.0:1788863740.138141:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 167 00000100:00100000:2.0:1788863740.138152:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:12273:x1875759205530752:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788863740.138179:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863740.138182:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788863740.138208:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b697cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880b7 expref: 18 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.138229:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863740.138234:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863740.138248:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b6987c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880e8 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.138361:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.138375:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 18 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.138384:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.138417:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 18 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.138451:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 18 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863740.138466:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226571904:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863740.138567:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863740.143251:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863740.143489:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226571904:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863740.143517:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863740.143664:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205530880 00000100:00100000:3.0:1788863740.143671:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205530880 00010000:00010000:3.0:1788863740.143705:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 19 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863740.143773:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:3.0:1788863740.143783:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:2408:x1875759205530880:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863740.143800:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863740.143807:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 19 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.143819:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 19 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.143842:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6984b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880da expref: 19 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.143870:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:3.0:1788863740.143878:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.143889:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.143898:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863740.143942:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863740.144005:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:2408:x1875759205530880:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 223us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863740.144013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 81 00010000:00010000:0.0:1788863740.144201:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.144209:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863740.144229:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788863740.144358:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b6987c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.144374:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 18 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.144382:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863740.144385:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788863740.144387:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641536200, rc 0) 00000100:00100000:0.0:1788863740.144423:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:12273:x1875759205530752:12345-192.168.204.35@tcp:101:dd.0 Request processed in 6273us (6546us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788863740.144430:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 167 00000100:00100000:2.0:1788863740.147561:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863740.147646:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205531008 00000100:00100000:0.0:1788863740.147657:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205531008 00000100:00100000:0.0:1788863740.147718:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 168 00000100:00100000:0.0:1788863740.147729:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:12273:x1875759205531008:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1788863740.147778:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863740.147796:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b69891 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880ef expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.147831:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.147846:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.147869:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.147985:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b69891 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 20 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.148002:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.148010:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863740.148013:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863740.148017:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b000, rc 0) 00000100:00100000:0.0:1788863740.148272:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:12273:x1875759205531008:12345-192.168.204.35@tcp:101:dd.0 Request processed in 543us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.148279:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 168 00000100:00100000:3.0:1788863740.161643:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863740.162136:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205531264 00000100:00100000:1.0:1788863740.162147:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205531264 00000100:00100000:1.0:1788863740.162225:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 169 00000100:00100000:1.0:1788863740.162236:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:12273:x1875759205531264:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:1.0:1788863740.162507:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.163767:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.163782:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863740.163874:0:10368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788863740.163918:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6194636 reply state 000000001e24215d transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.163932:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.164867:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:1.0:1788863740.164871:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863740.164877:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863740.165700:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:12273:x1875759205531264:12345-192.168.204.35@tcp:36:dd.0 Request processed in 3448us (4051us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788863740.165711:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 169 00000020:00080000:1.0:1788863740.165718:0:10368:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788863740.398585:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.398628:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.398680:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.398702:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.398719:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.398756:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205531648 00000100:00100000:2.0:1788863740.398766:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205531648 00000100:00100000:2.0:1788863740.398823:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205531776 00000100:00100000:2.0:1788863740.398826:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205531776 00000100:00100000:2.0:1788863740.398861:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:2.0:1788863740.398870:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205531648:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863740.399223:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:0.0:1788863740.399236:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2410:x1875759205531776:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863740.399309:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2410:x1875759205531776:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 77us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.399331:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:0.0:1788863740.399363:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205531904 00000100:00100000:0.0:1788863740.399367:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205531904 00000100:00100000:0.0:1788863740.399407:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205531520 00000100:00100000:0.0:1788863740.399410:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205531520 00000100:00100000:0.0:1788863740.399432:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 343 00000100:00100000:0.0:1788863740.399438:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205531904:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863740.399467:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205531904:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.399472:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 343 00000100:00100000:0.0:1788863740.399487:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 344 00000100:00100000:0.0:1788863740.399492:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205531520:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863740.399517:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205531520:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 24us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.399523:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 344 00000100:00080000:0.0:1788863740.399561:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863740.399565:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863740.399567:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863740.399569:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863740.399959:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2410:x1875759205531648:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1088us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863740.399967:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:2.0:1788863740.400032:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.400598:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205531392 00000100:00100000:2.0:1788863740.400607:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205531392 00000100:00100000:2.0:1788863740.400641:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 392 00000100:00100000:2.0:1788863740.400648:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205531392:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863740.400713:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205531392:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 65us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863740.400720:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 392 00000100:00100000:2.0:1788863740.400763:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205532032 00000100:00100000:2.0:1788863740.400767:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205532032 00000100:00080000:2.0:1788863740.400784:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863740.400805:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 345 00000100:00100000:2.0:1788863740.400812:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205532032:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863740.400839:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205532032:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863740.400856:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 345 00000100:00100000:0.0:1788863740.403413:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226572032:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403483:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.403544:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226572544:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.403585:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226573056:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.403644:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788863740.403649:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226572160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.403681:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226572672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403700:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.403713:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226573184:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.403759:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226573056 00000100:00100000:0.0:1788863740.403767:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226573056 00000100:00100000:0.0:1788863740.403811:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572160 00000100:00100000:0.0:1788863740.403814:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572160 00000100:00100000:0.0:1788863740.403826:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572672 00000100:00100000:0.0:1788863740.403828:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572672 00000100:00100000:0.0:1788863740.403842:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788863740.403864:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226573056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403920:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226573056:12345-0@lo:400:kworker.0 Request processed in 58us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.403926:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788863740.403942:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788863740.403948:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226572160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.403971:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226572160:12345-0@lo:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.403976:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788863740.403984:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788863740.403990:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226572672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404011:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226572672:12345-0@lo:400:kworker.0 Request processed in 22us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.404026:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788863740.404060:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226572160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404069:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226572672:0@lo:400:kworker.0 00010000:00080000:0.0:1788863740.404108:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543925500 x1875759226573056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863740.404120:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226573056:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404165:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226572288:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404189:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.404207:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226572800:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.404237:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788863740.404242:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226572416:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.404572:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226572928:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404600:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.404629:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572544 00000100:00100000:0.0:1788863740.404634:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572544 00000100:00100000:0.0:1788863740.404662:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572288 00000100:00100000:0.0:1788863740.404679:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572288 00000100:00100000:0.0:1788863740.404694:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788863740.404700:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226572544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404741:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226572544:12345-0@lo:400:kworker.0 Request processed in 41us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.404746:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788863740.404768:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788863740.404774:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226572288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.404805:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226572288:12345-0@lo:400:kworker.0 Request processed in 31us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.404810:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788863740.404824:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572800 00000100:00100000:0.0:1788863740.404827:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572800 00000100:00100000:0.0:1788863740.404862:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572416 00000100:00100000:0.0:1788863740.404865:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572416 00000100:00100000:0.0:1788863740.404877:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572928 00000100:00100000:0.0:1788863740.404879:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572928 00000100:00100000:0.0:1788863740.404890:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788863740.404895:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226572800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.406282:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226572800:12345-0@lo:400:kworker.0 Request processed in 1380us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.406293:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788863740.406326:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788863740.406336:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226572416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.406366:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226572416:12345-0@lo:400:kworker.0 Request processed in 35us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.406371:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:2.0:1788863740.406502:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863740.406506:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863740.406572:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226572032 00000100:00100000:1.0:1788863740.406579:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226572032 00000100:00100000:1.0:1788863740.406620:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788863740.406625:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226572032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863740.406658:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226572032:12345-0@lo:400:kworker.0 Request processed in 33us (3175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863740.406663:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788863740.406749:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226572032:0@lo:400:kworker.0 00000100:00100000:1.0:1788863740.406778:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226572544:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.406822:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788863740.406831:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226572928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.406870:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226572928:12345-0@lo:400:kworker.0 Request processed in 42us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863740.409701:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226573184 00000100:00100000:3.0:1788863740.409717:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226573184 00000100:00100000:3.0:1788863740.409791:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788863740.409802:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226573184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863740.410354:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226573184:12345-0@lo:400:kworker.0 Request processed in 553us (6620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863740.410362:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788863740.410456:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863740.410501:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226573184:0@lo:400:kworker.0 00000100:00100000:3.0:1788863740.410645:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226572416:0@lo:400:kworker.0 00000100:00100000:3.0:1788863740.410657:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226572928:0@lo:400:kworker.0 00000100:00100000:3.0:1788863740.410667:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226572288:0@lo:400:kworker.0 00010000:00080000:3.0:1788863740.411503:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af55880 x1875759226572800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863740.411515:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226572800:0@lo:400:kworker.0 00000100:00100000:0.0:1788863740.415389:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788863740.586170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863740.586289:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205532160 00000100:00100000:0.0:1788863740.586310:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205532160 00000100:00100000:0.0:1788863740.586371:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 170 00000100:00100000:0.0:1788863740.586381:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:12287:x1875759205532160:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:0.0:1788863740.586407:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863740.586428:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880f6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586496:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586511:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586522:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586536:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586544:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586551:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586624:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586635:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 23 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586644:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586684:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 23 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.586697:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 23 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863740.586712:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54376a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226573312:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863740.587006:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863740.591110:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.591347:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205532416 00000100:00100000:2.0:1788863740.591360:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205532416 00000100:00100000:2.0:1788863740.591417:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:2.0:1788863740.591426:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:6186:x1875759205532416:12345-192.168.204.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788863740.591717:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:6186:x1875759205532416:12345-192.168.204.35@tcp:35:ldlm_bl.0 Request processed in 290us (643us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788863740.591724:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:0.0:1788863740.592524:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54376a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226573312:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863740.592557:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863740.594823:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863740.595113:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205532544 00000100:00100000:1.0:1788863740.595123:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205532544 00010000:00010000:1.0:1788863740.595165:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 25 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863740.595253:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:1.0:1788863740.595264:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:2408:x1875759205532544:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863740.595292:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863740.595300:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 25 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.595314:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 25 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.595337:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b69883 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880e8 expref: 25 pid: 6536 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.595355:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:1.0:1788863740.595360:0:10356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.595371:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.595380:0:10356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863740.595434:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863740.595500:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:2408:x1875759205532544:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 238us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863740.595508:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 82 00010000:00010000:0.0:1788863740.595744:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595753:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863740.595807:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788863740.595811:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863740.595834:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595864:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595874:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595891:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595896:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595902:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863740.595906:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595914:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595925:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863740.595928:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863740.595932:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595939:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b698ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595951:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595956:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595961:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595965:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863740.595973:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.595991:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.596002:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6af00) 00010000:00010000:0.0:1788863740.596005:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863740.596008:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.596015:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.596054:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880f6 expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.596068:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880f6 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.596138:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863740.596140:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863740.596143:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259be00, rc 0) 00000100:00100000:0.0:1788863740.596219:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:12287:x1875759205532160:12345-192.168.204.35@tcp:101:stat.0 Request processed in 9838us (10058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863740.596226:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 170 00000100:00100000:2.0:1788863740.680538:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863740.680699:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205532800 00000100:00100000:0.0:1788863740.680711:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205532800 00000100:00100000:0.0:1788863740.680785:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 171 00000100:00100000:0.0:1788863740.680796:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:12293:x1875759205532800:12345-192.168.204.35@tcp:36:truncate.0 00010000:00010000:0.0:1788863740.680878:0:12972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863740.680909:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880f6 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.680931:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863740.680936:0:12972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863740.681203:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.681217:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.681226:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863740.681279:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788863740.681303:0:12972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060de53f4 reply state 00000000d13423ef transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.681315:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863740.681321:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863740.681324:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863740.681326:0:12972:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863740.681442:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12293:x1875759205532800:12345-192.168.204.35@tcp:36:truncate.0 Request processed in 645us (913us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788863740.681450:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 171 00000020:00080000:0.0:1788863740.681456:0:12972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788863740.870576:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863740.870706:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205532928 00000100:00100000:2.0:1788863740.870719:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205532928 00000100:00100000:2.0:1788863740.870800:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 172 00000100:00100000:2.0:1788863740.870818:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12307:x1875759205532928:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:2.0:1788863740.870854:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863740.870879:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b698c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251880fd expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.870967:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.870992:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871004:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871021:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871028:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871034:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871144:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871152:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871160:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863740.871212:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788863740.871216:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863740.871237:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871249:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871268:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871275:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871283:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871288:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863740.871293:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871300:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871312:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863740.871315:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863740.871320:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871325:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b698d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871352:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871357:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871363:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871368:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863740.871370:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871376:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871383:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e54382e500) 00010000:00010000:2.0:1788863740.871386:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863740.871388:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871394:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b698d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871425:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b698c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 27 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871437:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863740.871455:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:2.0:1788863740.871457:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863740.871460:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641536200, rc 0) 00000100:00100000:2.0:1788863740.871534:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12307:x1875759205532928:12345-192.168.204.35@tcp:101:stat.0 Request processed in 718us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863740.871543:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 172 00000100:00100000:0.0:1788863740.907835:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226573568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863740.907942:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863740.908027:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863740.908033:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226573440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863740.908055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863740.908142:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226573568 00000100:00100000:1.0:1788863740.908151:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226573568 00000100:00100000:1.0:1788863740.908186:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226573440 00000100:00100000:1.0:1788863740.908188:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226573440 00000100:00100000:1.0:1788863740.908200:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788863740.908208:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226573568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863740.908236:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863740.908292:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226573568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863740.908299:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788863740.908314:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788863740.908319:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875759226573440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863740.908329:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863740.908347:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875759226573440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863740.908352:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788863740.908537:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226573440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863740.908549:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226573568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863741.037886:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.038104:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205533184 00000100:00100000:0.0:1788863741.038116:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205533184 00000100:00100000:0.0:1788863741.038224:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 173 00000100:00100000:0.0:1788863741.038235:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12317:x1875759205533184:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863741.038269:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863741.038293:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188104 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863741.038428:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788863741.038548:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188104 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.038565:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:0.0:1788863741.038569:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863741.038574:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188104 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.038590:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259be00, rc 0) 00000100:00100000:0.0:1788863741.038856:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12317:x1875759205533184:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 621us (979us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788863741.038877:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 173 00000100:00100000:3.0:1788863741.046121:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.047700:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205533440 00000100:00100000:0.0:1788863741.047716:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205533440 00000100:00100000:0.0:1788863741.047786:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:0.0:1788863741.047798:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671bdb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12317:x1875759205533440:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788863741.048073:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671bdb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:12317:x1875759205533440:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 277us (2008us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788863741.048099:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00010000:00010000:1.0:1788863741.099632:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863741.141847:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.143754:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205533696 00000100:00100000:0.0:1788863741.143771:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205533696 00000100:00100000:0.0:1788863741.143855:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 174 00000100:00100000:0.0:1788863741.143866:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:12323:x1875759205533696:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863741.143893:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863741.143921:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518810b expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.144039:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.144056:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 29 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.144066:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.144139:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 29 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.144173:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 29 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863741.144189:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226573696:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863741.144611:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863741.148964:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226573696:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863741.148996:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863741.150177:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863741.150404:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205533824 00000100:00100000:2.0:1788863741.150414:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205533824 00010000:00010000:2.0:1788863741.150457:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 30 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863741.150492:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:2.0:1788863741.150502:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:2408:x1875759205533824:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863741.150519:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863741.150526:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 30 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.150539:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 30 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.150563:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536200/0xf569beb9d4b698de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880fd expref: 30 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.150580:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:2.0:1788863741.150599:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.150611:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.150619:0:10355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.150660:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863741.150983:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:2408:x1875759205533824:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 226us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863741.150992:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 83 00010000:00010000:0.0:1788863741.151117:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.151127:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863741.151153:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788863741.151573:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b698f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.151603:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 29 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.151612:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863741.151619:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788863741.151624:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863741.151690:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:12323:x1875759205533696:12345-192.168.204.35@tcp:101:bash.0 Request processed in 7826us (9864us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788863741.151799:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 174 00000100:00100000:1.0:1788863741.161161:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.161326:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205534080 00000100:00100000:0.0:1788863741.161341:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205534080 00000100:00100000:0.0:1788863741.161411:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 175 00000100:00100000:0.0:1788863741.161423:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:12323:x1875759205534080:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:0.0:1788863741.161697:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.161716:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.161742:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863741.161791:0:10368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788863741.161814:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c6ae9cf reply state 00000000e372c4eb transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.161827:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.161848:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863741.162170:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863741.162177:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863741.162442:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:12323:x1875759205534080:12345-192.168.204.35@tcp:36:bash.0 Request processed in 1018us (1291us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788863741.162451:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 175 00000020:00080000:0.0:1788863741.162457:0:10368:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788863741.170805:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.171140:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205534208 00000100:00100000:0.0:1788863741.171168:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205534208 00000100:00100000:0.0:1788863741.171245:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 176 00000100:00100000:0.0:1788863741.171256:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:12323:x1875759205534208:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863741.171282:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863741.171505:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6990f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188112 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.171635:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.171651:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 33 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.171661:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.171695:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 33 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.171708:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 33 pid: 6536 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863741.171928:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226573824:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863741.172019:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863741.179542:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.179689:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226573824:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863741.179732:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863741.179878:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205534336 00000100:00100000:1.0:1788863741.179887:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205534336 00010000:00010000:1.0:1788863741.179935:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 34 pid: 6536 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863741.179975:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 84 00000100:00100000:1.0:1788863741.179985:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:2409:x1875759205534336:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863741.180001:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863741.180009:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 34 pid: 6536 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863741.180020:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 34 pid: 6536 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863741.180042:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b698fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518810b expref: 34 pid: 6536 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863741.180057:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:1.0:1788863741.180062:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863741.180070:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863741.180187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863741.180219:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863741.180273:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:2409:x1875759205534336:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 289us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863741.180281:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 84 00010000:00010000:0.0:1788863741.180517:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.180533:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863741.180600:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788863741.180605:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863741.180629:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.180661:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6990f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188112 expref: 34 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.180676:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188112 expref: 33 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.180683:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863741.180685:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863741.180688:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259ba00, rc 0) 00000100:00100000:0.0:1788863741.180721:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:12323:x1875759205534208:12345-192.168.204.35@tcp:101:bash.0 Request processed in 9467us (9929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.180740:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 176 00000100:00100000:1.0:1788863741.188398:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.188588:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205534592 00000100:00100000:0.0:1788863741.188602:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205534592 00000100:00100000:0.0:1788863741.188817:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:0.0:1788863741.188840:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:12323:x1875759205534592:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:0.0:1788863741.189280:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:12323:x1875759205534592:12345-192.168.204.35@tcp:35:bash.0 Request processed in 450us (891us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788863741.189288:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:3.0:1788863741.322120:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.322203:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205534848 00000100:00100000:0.0:1788863741.322213:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205534848 00000100:00100000:0.0:1788863741.322283:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 177 00000100:00100000:0.0:1788863741.322292:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+33:12333:x1875759205534848:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863741.322319:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863741.322340:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6991d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188119 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863741.322440:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788863741.322540:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6991d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188119 expref: 35 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.322556:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:0.0:1788863741.322560:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863741.322565:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6991d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188119 expref: 35 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.322579:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b600, rc 0) 00000100:00100000:0.0:1788863741.322714:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:12333:x1875759205534848:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 423us (603us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788863741.322721:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 177 00000100:00100000:3.0:1788863741.332755:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.336486:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205534976 00000100:00100000:0.0:1788863741.336505:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205534976 00000100:00100000:0.0:1788863741.336655:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 178 00000100:00100000:0.0:1788863741.336669:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:12333:x1875759205534976:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:0.0:1788863741.336760:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336798:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336812:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336840:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336848:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336855:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336929:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336938:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.336945:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863741.337015:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337030:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337036:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337053:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337059:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863741.337063:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337071:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337105:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863741.337108:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863741.337113:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337120:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b6992b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337133:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337139:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337146:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337150:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863741.337153:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337168:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337176:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6af00) 00010000:00010000:0.0:1788863741.337178:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863741.337181:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337187:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337202:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337207:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337212:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337217:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863741.337220:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337226:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337232:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863741.337234:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863741.337237:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.337262:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863741.337352:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:12333:x1875759205534976:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 686us (4607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.337360:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 178 00000100:00100000:1.0:1788863741.342206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863741.342316:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205535232 00000100:00100000:3.0:1788863741.342328:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205535232 00000100:00100000:3.0:1788863741.342395:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:3.0:1788863741.342407:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:12333:x1875759205535232:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788863741.342703:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:12333:x1875759205535232:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 297us (508us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788863741.342710:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:0.0:1788863741.412302:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863741.412972:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205535488 00000100:00100000:2.0:1788863741.412983:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205535488 00000100:00100000:2.0:1788863741.413060:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 179 00000100:00100000:2.0:1788863741.413072:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:12336:x1875759205535488:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863741.413133:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863741.413156:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69940 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188120 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413237:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413265:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413277:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413292:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413313:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413320:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413452:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69955 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413462:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413470:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863741.413804:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788863741.413909:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413917:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413924:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413931:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863741.413937:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413945:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413973:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863741.413976:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863741.413982:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.413989:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69947 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414005:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414011:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414016:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414020:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863741.414023:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414029:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414037:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e54382e500) 00010000:00010000:2.0:1788863741.414040:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863741.414043:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414049:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b6994e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414302:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69940 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188120 expref: 38 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414318:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188120 expref: 37 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.414337:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:2.0:1788863741.414339:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863741.414342:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537a00, rc 0) 00000100:00100000:2.0:1788863741.414458:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12336:x1875759205535488:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1388us (2167us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788863741.414466:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 179 00000100:00100000:2.0:1788863741.420054:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863741.420110:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226573952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863741.420188:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863741.420364:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226573952 00000100:00100000:0.0:1788863741.420373:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226573952 00000100:00100000:0.0:1788863741.420429:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788863741.420439:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671280050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226573952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863741.420488:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788863741.420548:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671280050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226573952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.420556:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788863741.420884:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226573952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863741.425576:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226574080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863741.425658:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863741.425964:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226574080 00000100:00100000:0.0:1788863741.425972:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226574080 00000100:00100000:0.0:1788863741.426039:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788863741.426049:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226574080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863741.426119:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788863741.426168:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226574080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.426175:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788863741.426272:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226574080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863741.431119:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863741.431169:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863741.431265:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205535744 00000100:00100000:1.0:1788863741.431275:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205535744 00000100:00100000:1.0:1788863741.431348:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:1.0:1788863741.431358:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:2408:x1875759205535744:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863741.431375:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863741.431401:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188120 expref: 37 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863741.431421:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:1.0:1788863741.431426:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863741.431500:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:2408:x1875759205535744:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 143us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863741.431507:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:0.0:1788863741.433068:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205535616 00000100:00100000:0.0:1788863741.433110:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205535616 00000100:00100000:0.0:1788863741.433192:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 180 00000100:00100000:0.0:1788863741.433202:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:12336:x1875759205535616:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:0.0:1788863741.433292:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433312:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433679:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433792:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433801:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433808:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433814:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863741.433819:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433838:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433852:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863741.433855:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863741.433860:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.433883:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69963 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863741.433972:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:12336:x1875759205535616:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 770us (2903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.433980:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 180 00000100:00100000:2.0:1788863741.440872:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863741.441578:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205536000 00000100:00100000:3.0:1788863741.441592:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205536000 00000100:00100000:3.0:1788863741.441658:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:3.0:1788863741.441669:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+36:12336:x1875759205536000:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788863741.442027:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12336:x1875759205536000:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 358us (1165us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788863741.442035:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:1.0:1788863741.681072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.681693:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205536256 00000100:00100000:0.0:1788863741.681705:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205536256 00000100:00100000:0.0:1788863741.681780:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 181 00000100:00100000:0.0:1788863741.681792:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12354:x1875759205536256:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:0.0:1788863741.681830:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863741.681854:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6996a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188127 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.681976:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69971 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.681999:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.682011:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863741.682028:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788863741.682192:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6996a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188127 expref: 40 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.682211:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69971 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188127 expref: 39 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.682234:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863741.682237:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788863741.682240:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b800, rc 0) 00000100:00100000:0.0:1788863741.682311:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12354:x1875759205536256:12345-192.168.204.35@tcp:101:cat.0 Request processed in 521us (1251us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788863741.682318:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 181 00000100:00100000:2.0:1788863741.744369:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.744768:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205536384 00000100:00100000:0.0:1788863741.744779:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205536384 00000100:00100000:0.0:1788863741.744908:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 182 00000100:00100000:0.0:1788863741.744931:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12355:x1875759205536384:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863741.744958:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863741.744979:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6997f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518812e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.745062:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69986 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.745104:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.745115:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863741.745168:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788863741.745172:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863741.745192:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.745242:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6997f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518812e expref: 41 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.745260:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518812e expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.745268:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863741.745271:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863741.745275:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b600, rc 0) 00000100:00100000:0.0:1788863741.745368:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12355:x1875759205536384:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 443us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.745376:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 182 00000100:00100000:2.0:1788863741.754191:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863741.754275:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205536768 00000100:00100000:3.0:1788863741.754286:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205536768 00000100:00100000:3.0:1788863741.754347:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:3.0:1788863741.754357:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12355:x1875759205536768:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788863741.754643:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12355:x1875759205536768:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 287us (461us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788863741.754652:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:1.0:1788863741.759674:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863741.759793:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205536896 00000100:00100000:2.0:1788863741.759805:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205536896 00000100:00100000:2.0:1788863741.759909:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:2.0:1788863741.759920:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12355:x1875759205536896:12345-192.168.204.35@tcp:103:lfs.0 00010000:00010000:2.0:1788863741.759939:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788863741.759967:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69916 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188112 expref: 41 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.760005:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69971 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188127 expref: 40 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.760019:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b6980c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880cc expref: 39 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863741.760029:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:2.0:1788863741.760035:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863741.760231:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12355:x1875759205536896:12345-192.168.204.35@tcp:103:lfs.0 Request processed in 312us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863741.760239:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:2.0:1788863741.764944:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.765110:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205537024 00000100:00100000:0.0:1788863741.765121:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205537024 00000100:00100000:0.0:1788863741.765187:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 183 00000100:00100000:0.0:1788863741.765197:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12355:x1875759205537024:12345-192.168.204.35@tcp:58:lfs.0 00010000:00010000:0.0:1788863741.765326:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.765345:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.765357:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863741.765461:0:12972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788863741.765546:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12355:x1875759205537024:12345-192.168.204.35@tcp:58:lfs.0 Request processed in 349us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.765568:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 183 00000100:00100000:3.0:1788863741.802952:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863741.803192:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205537152 00000100:00100000:0.0:1788863741.803203:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205537152 00000100:00100000:0.0:1788863741.803269:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 184 00000100:00100000:0.0:1788863741.803278:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12357:x1875759205537152:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863741.803300:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863741.803322:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69994 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188135 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803387:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803404:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803416:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803430:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803437:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803444:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803525:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803560:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803567:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863741.803613:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788863741.803618:0:10368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863741.803637:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803648:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803657:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803663:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803671:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803677:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863741.803681:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803688:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803700:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863741.803721:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863741.803727:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803734:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b6999b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803750:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803757:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803762:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803766:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863741.803769:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803775:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803783:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6af00) 00010000:00010000:0.0:1788863741.803786:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863741.803789:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803795:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803837:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69994 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 40 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803973:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 39 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863741.803982:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863741.803985:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863741.803987:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863741.804056:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12357:x1875759205537152:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 779us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863741.804064:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 184 00000040:00080000:2.0:1788863742.068238:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863742.068246:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863742.068289:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788863742.068296:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788863742.068585:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67aed7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226574208:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788863742.068738:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863742.090708:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67aed7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226574208:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788863742.096266:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.096344:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205537280 00000100:00100000:1.0:1788863742.096355:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205537280 00000100:00100000:1.0:1788863742.096431:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00100000:1.0:1788863742.096443:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12368:x1875759205537280:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788863742.096474:0:6537:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788863742.096586:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12368:x1875759205537280:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 145us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.096594:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00080000:3.0:1788863742.097106:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863742.104405:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.104641:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205537408 00000100:00100000:1.0:1788863742.104652:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205537408 00000100:00100000:1.0:1788863742.104724:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:1.0:1788863742.104734:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12368:x1875759205537408:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788863742.104808:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.104837:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.104851:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.104868:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.104875:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.104881:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.104999:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105011:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105018:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863742.105066:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788863742.105070:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863742.105109:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105129:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105135:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105143:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105150:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863742.105154:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105162:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105176:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:1.0:1788863742.105179:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863742.105184:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105190:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b699b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105204:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105210:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105216:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105226:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863742.105229:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105236:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105243:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff89e643aa2b00) 00010000:00010000:1.0:1788863742.105246:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863742.105248:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105254:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105268:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105275:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105281:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105286:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863742.105289:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105294:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105310:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:1.0:1788863742.105313:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863742.105316:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.105321:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863742.106310:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12368:x1875759205537408:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 Request processed in 1569us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.106321:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:3.0:1788863742.117513:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863742.117858:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205537664 00000100:00100000:0.0:1788863742.117869:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205537664 00000100:00100000:0.0:1788863742.117949:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 187 00000100:00100000:0.0:1788863742.117958:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12368:x1875759205537664:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863742.117981:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863742.118003:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518813c expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118143:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118162:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118175:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863742.118186:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788863742.118279:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118287:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118293:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118298:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863742.118302:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118310:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118322:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863742.118325:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863742.118330:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118336:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118581:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518813c expref: 41 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118593:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:0.0:1788863742.118595:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863742.118599:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518813c expref: 41 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.118620:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b400, rc 0) 00000100:00100000:0.0:1788863742.118692:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12368:x1875759205537664:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 734us (1188us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788863742.118699:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 187 00010000:00010000:3.0:1788863742.125167:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863742.125463:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.125540:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205537792 00000100:00100000:1.0:1788863742.125550:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205537792 00000100:00100000:1.0:1788863742.125614:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 188 00000100:00100000:1.0:1788863742.125624:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12368:x1875759205537792:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788863742.125659:0:12972:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788863742.126048:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12368:x1875759205537792:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 147us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.126058:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 188 00000100:00100000:3.0:1788863742.141637:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.141757:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205538048 00000100:00100000:1.0:1788863742.141767:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205538048 00000100:00100000:1.0:1788863742.141831:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 189 00000100:00100000:1.0:1788863742.141841:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12368:x1875759205538048:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863742.141860:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863742.141863:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788863742.141890:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69986 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518812e expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.141929:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863742.141934:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863742.141950:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699da lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188143 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863742.142576:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788863742.142718:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.142732:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.142743:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.142799:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699da lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188143 expref: 42 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.142827:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188143 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.142834:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:1.0:1788863742.142837:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863742.142840:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ec00, rc 0) 00000100:00100000:1.0:1788863742.147559:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12368:x1875759205538048:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 5706us (5918us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788863742.147572:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 189 00000100:00100000:3.0:1788863742.161913:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863742.163618:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205538304 00000100:00100000:0.0:1788863742.163632:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205538304 00000100:00100000:0.0:1788863742.163708:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 190 00000100:00100000:0.0:1788863742.163718:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12368:x1875759205538304:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788863742.163777:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863742.163802:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b699e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188143 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163838:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2b00) 00010000:00010000:0.0:1788863742.163848:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863742.163871:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163884:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163894:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163916:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163923:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163946:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163988:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.163995:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164002:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164007:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863742.164011:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164019:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164026:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863742.164029:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863742.164033:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164039:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b699ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164048:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164053:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164125:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164131:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863742.164134:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164141:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164149:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xf8d9e71b (ffff89e681a6af00) 00010000:00010000:0.0:1788863742.164151:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863742.164154:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.164159:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b699f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf8d9e71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.164251:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12368:x1875759205538304:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 534us (2349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863742.164259:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 190 00000100:00100000:3.0:1788863742.176373:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.176575:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205538432 00000100:00100000:1.0:1788863742.176586:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205538432 00000100:00100000:1.0:1788863742.176642:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 191 00000100:00100000:1.0:1788863742.176651:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12368:x1875759205538432:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863742.176673:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863742.176697:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518814a expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.176733:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.176748:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.176760:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.176887:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b699fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 42 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.176920:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 41 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.176929:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:1.0:1788863742.176932:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788863742.176935:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e000, rc 0) 00000100:00100000:1.0:1788863742.177058:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12368:x1875759205538432:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 407us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.177073:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 191 00000100:00100000:0.0:1788863742.199826:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.199937:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205538688 00000100:00100000:1.0:1788863742.199949:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205538688 00000100:00100000:1.0:1788863742.200019:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 192 00000100:00100000:1.0:1788863742.200031:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12368:x1875759205538688:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788863742.200147:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.200166:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.200179:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863742.200361:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788863742.200373:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409324295677ns, next at 410324292874ns, rc = 0 00000004:00010000:1.0:1788863742.200425:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000027e6364 reply state 00000000de9073c8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.200440:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.200449:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:1.0:1788863742.200452:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788863742.200455:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863742.200794:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+43:12368:x1875759205538688:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 764us (986us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788863742.200802:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 192 00000100:00100000:0.0:1788863742.205419:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863742.206603:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205538816 00000100:00100000:2.0:1788863742.206619:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205538816 00000100:00100000:2.0:1788863742.206734:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00100000:2.0:1788863742.206747:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+43:12368:x1875759205538816:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863742.206773:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863742.206794:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188151 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.206871:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 44 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.206887:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 44 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.206907:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:2.0:1788863742.206911:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863742.206915:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537c00, rc 0) 00000100:00100000:2.0:1788863742.207009:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+44:12368:x1875759205538816:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 264us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863742.207016:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00100000:2.0:1788863742.233746:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863742.234167:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205538944 00000100:00100000:0.0:1788863742.234178:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205538944 00000100:00100000:0.0:1788863742.234263:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:0.0:1788863742.234289:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67aed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+6:2411:x1875759205538944:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788863742.234528:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67aed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205538944:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 256us (792us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788863742.234551:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00080000:3.0:1788863742.234584:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863742.243407:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.243478:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205539200 00000100:00100000:3.0:1788863742.243489:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205539200 00000100:00100000:3.0:1788863742.243541:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:3.0:1788863742.243550:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+44:12368:x1875759205539200:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788863742.243961:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:12368:x1875759205539200:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 410us (561us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788863742.243969:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:0.0:1788863742.253383:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.253466:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205539456 00000100:00100000:3.0:1788863742.253476:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205539456 00000100:00100000:3.0:1788863742.253542:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 194 00000100:00100000:3.0:1788863742.253553:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:12368:x1875759205539456:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788863742.253781:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:12368:x1875759205539456:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 230us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.253790:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 194 00000100:00100000:1.0:1788863742.264970:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.265031:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205539584 00000100:00100000:3.0:1788863742.265043:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205539584 00000100:00100000:3.0:1788863742.265267:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 195 00000100:00100000:3.0:1788863742.265286:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:12368:x1875759205539584:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863742.265307:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863742.265330:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69a19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188158 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.265403:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.265454:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.265468:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863742.265516:0:10368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863742.265535:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.265561:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69a19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188158 expref: 47 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.265578:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188158 expref: 46 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.265586:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:3.0:1788863742.265589:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788863742.265592:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031400, rc 0) 00000100:00100000:3.0:1788863742.265673:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:12368:x1875759205539584:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 396us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.265680:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 195 00000100:00100000:2.0:1788863742.285210:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.285373:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205539712 00000100:00100000:3.0:1788863742.285382:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205539712 00000100:00100000:3.0:1788863742.285441:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:3.0:1788863742.285451:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205539712:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863742.285470:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863742.285503:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518815f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863742.285530:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe4fe, blocks: 0x0 00010000:00010000:3.0:1788863742.285550:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1788863742.285555:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863742.285565:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.285582:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.285596:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031800, rc 0) 00000100:00100000:3.0:1788863742.285674:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205539712:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 225us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.285681:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:0.0:1788863742.293915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.293999:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205539968 00000100:00100000:1.0:1788863742.294009:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205539968 00000100:00100000:1.0:1788863742.294150:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 196 00000100:00100000:1.0:1788863742.294160:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:12368:x1875759205539968:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788863742.294262:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:12368:x1875759205539968:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 103us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.294270:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 196 00000100:00100000:1.0:1788863742.304464:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.304678:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205540096 00000100:00100000:3.0:1788863742.304690:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205540096 00000100:00100000:3.0:1788863742.304758:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788863742.304768:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:12368:x1875759205540096:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863742.304787:0:8606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863742.304805:0:8606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188166 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.304851:0:8606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.304880:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863742.304884:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863742.304891:0:8606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 9 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.304933:0:8606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.304948:0:8606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 9 pid: 8451 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.304964:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8606:1875759226574336:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863742.307907:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863742.308642:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8606:1875759226574336:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863742.308676:0:8606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 9 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.308698:0:8606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030800, rc 0) 00000100:00100000:3.0:1788863742.308822:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:12368:x1875759205540096:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 4045us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.308832:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:1.0:1788863742.312449:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.312545:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205540224 00000100:00100000:3.0:1788863742.312555:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205540224 00010000:00010000:3.0:1788863742.312600:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 9 pid: 8451 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.312661:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 85 00000100:00100000:3.0:1788863742.312672:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2409:x1875759205540224:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863742.312686:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863742.312708:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 9 pid: 8451 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.312722:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 9 pid: 8451 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.312745:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b69a27 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518815f expref: 9 pid: 8451 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.312762:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863742.312766:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863742.312774:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 8 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.312786:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 8 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.312837:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 8 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.312851:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6524:1875759226574464:192.168.204.35@tcp:105: 00000100:00100000:3.0:1788863742.312947:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863742.318831:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.318938:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6524:1875759226574464:192.168.204.35@tcp:105: 00010000:00010000:3.0:1788863742.318959:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863742.319016:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205540224:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 6346us (6577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.319027:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 85 00000100:00100000:2.0:1788863742.319960:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205540352 00000100:00100000:2.0:1788863742.319970:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205540352 00002000:00100000:2.0:1788863742.320017:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff89e543924a80 x1875759205540352/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:728/0 lens 504/0 e 0 to 0 dl 1788863753 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863742.320026:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e543924a80 with x1875759205540352 ext(0->8) 00002000:00010000:2.0:1788863742.320032:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e543924a80 00000100:00100000:2.0:1788863742.320095:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:2.0:1788863742.320114:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205540352:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788863742.324992:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2408:x1875759205540352:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 Request processed in 4869us (6170us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788863742.325006:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00002000:00100000:2.0:1788863742.325020:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff89e543924a80 x1875759205540352/t4294967315(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:728/0 lens 504/448 e 0 to 0 dl 1788863753 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863742.325029:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e543924a80 with x1875759205540352 ext(0->8) 00002000:00010000:2.0:1788863742.325036:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e543924a80 00000100:00100000:3.0:1788863742.336148:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863742.337776:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205540480 00000100:00100000:0.0:1788863742.337791:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205540480 00000100:00100000:0.0:1788863742.337867:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 197 00000100:00100000:0.0:1788863742.337877:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:12368:x1875759205540480:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788863742.345011:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788863742.345035:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788863742.345119:0:6516:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788863742.345244:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788863742.345256:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788863742.345273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226574592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788863742.345345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863742.345422:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226574592 00000100:00100000:0.0:1788863742.345431:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226574592 00000100:00100000:0.0:1788863742.345497:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863742.345508:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226574592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788863742.345657:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788863742.345662:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788863742 00002000:00010000:0.0:1788863742.345664:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788863742.345666:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788863742 -> 1788863742 00002000:00010000:0.0:1788863742.345669:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788863742.345728:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.345801:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.345819:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.345826:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863742.345832:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.345848:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226574592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 341us (503us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788863742.345868:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788863742.345893:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788863742.345982:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346004:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00000100:00100000:0.0:1788863742.346005:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:12368:x1875759205540480:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 Request processed in 8127us (9866us total) trans 0 rc 0/0 00010000:00010000:3.0:1788863742.346007:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863742.346013:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.346013:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 197 00010000:00010000:3.0:1788863742.346020:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6989f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346046:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346052:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346057:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346062:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259aa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863742.346065:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346071:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346165:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:3.0:1788863742.346168:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863742.346365:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346374:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b698c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346390:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346396:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346402:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346414:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259be00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863742.346418:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346424:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346434:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:3.0:1788863742.346437:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863742.346440:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346446:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69908 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346458:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346464:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346470:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346475:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863742.346478:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346484:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346581:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:3.0:1788863742.346586:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788863742.346590:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.346597:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863742.346597:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e54418ed80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788863742.346609:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226574592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788863742.358013:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.358345:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205540608 00000100:00100000:3.0:1788863742.358358:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205540608 00000100:00100000:3.0:1788863742.358463:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788863742.358474:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2411:x1875759205540608:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788863742.362379:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788863742.362399:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1788863742.362982:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205540608:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 Request processed in 4501us (4967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863742.362996:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:0.0:1788863742.373678:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.373861:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205540864 00000100:00100000:3.0:1788863742.373872:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205540864 00000100:00100000:3.0:1788863742.373933:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 198 00000100:00100000:3.0:1788863742.373944:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:12368:x1875759205540864:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863742.374000:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863742.374030:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69a20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188158 expref: 19 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.374047:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:3.0:1788863742.374053:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863742.374103:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.374120:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.374152:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863742.374295:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e83afb03 reply state 000000002a6f585c transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.374308:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.374316:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:3.0:1788863742.374319:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863742.374321:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863742.374417:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:12368:x1875759205540864:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 475us (750us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788863742.374425:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 198 00000100:00100000:0.0:1788863742.376883:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.376955:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205540992 00000100:00100000:3.0:1788863742.376967:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205540992 00000100:00100000:3.0:1788863742.377026:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:3.0:1788863742.377036:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205540992:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788863742.377236:0:8606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788863742.377239:0:8606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788863742 -> 1788863741 00002000:00010000:3.0:1788863742.377242:0:8606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788863739 00002000:00010000:3.0:1788863742.377244:0:8606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788863742 -> 1788863741 00002000:00010000:3.0:1788863742.377246:0:8606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788863742.377309:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205540992:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 275us (435us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788863742.377317:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:3.0:1788863742.379568:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863742.379760:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205541248 00000100:00100000:0.0:1788863742.379768:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205541248 00000100:00100000:0.0:1788863742.379856:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 199 00000100:00100000:0.0:1788863742.379865:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:12368:x1875759205541248:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788863742.379929:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.379946:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 20 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.379955:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.379985:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 20 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.380013:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 20 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.380027:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226574720:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863742.380134:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863742.386272:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226574720:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863742.386308:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.392885:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863742.393000:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205541376 00000100:00100000:3.0:1788863742.393010:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205541376 00010000:00010000:3.0:1788863742.393048:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 21 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.393108:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:3.0:1788863742.393117:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:2409:x1875759205541376:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863742.393131:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863742.393138:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 21 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.393152:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 21 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.393173:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518814a expref: 21 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.393188:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:3.0:1788863742.393193:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.393202:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.393210:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.393233:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863742.393289:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:2409:x1875759205541376:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 173us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.393296:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 86 00010000:00010000:2.0:1788863742.400376:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400396:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400443:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400450:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400472:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400487:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259bc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863742.400491:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400499:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400517:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:2.0:1788863742.400521:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788863742.400527:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.400533:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863742.400633:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:12368:x1875759205541248:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 Request processed in 20763us (21067us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788863742.400645:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 199 00000100:00100000:0.0:1788863742.403635:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.403714:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205541504 00000100:00100000:1.0:1788863742.403723:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205541504 00000100:00100000:1.0:1788863742.403780:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:1.0:1788863742.403791:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205541504:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788863742.403851:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.403874:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 8 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.403884:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863742.403888:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863742.403893:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.403929:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 8 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.403957:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 8 pid: 8606 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863742.403975:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1875759226574848:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863742.405613:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863742.416141:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863742.416178:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205541632 00000100:00100000:2.0:1788863742.416188:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205541632 00010000:00010000:2.0:1788863742.416229:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 9 pid: 8606 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863742.416274:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:2.0:1788863742.416284:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e449850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205541632:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863742.416301:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863742.416322:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 9 pid: 8606 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.416349:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 9 pid: 8606 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.416383:0:10355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863742.416388:0:10355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863742.416395:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.416405:0:10355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.416430:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863742.416652:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083b75811/0xf569beb9d4b69a2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188166 expref: 9 pid: 8606 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.416667:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1875759226574848:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863742.416688:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416697:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416705:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416725:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416733:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416741:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416748:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863742.416760:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416770:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416783:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.416791:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b69a43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863742.416884:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e449850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205541632:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 600us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863742.416893:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:3.0:1788863742.420047:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205541504:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 Request processed in 16247us (16411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.420062:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:3.0:1788863742.422487:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863742.422545:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205541888 00000100:00100000:0.0:1788863742.422556:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205541888 00000100:00100000:0.0:1788863742.422612:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 200 00000100:00100000:0.0:1788863742.422622:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:12368:x1875759205541888:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788863742.422698:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.422716:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.422727:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.422762:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 19 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.422776:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 19 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.422819:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226574976:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863742.422913:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863742.425820:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863742.425854:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205542016 00000100:00100000:0.0:1788863742.425863:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205542016 00010000:00010000:0.0:1788863742.425906:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 20 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.425947:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 88 00000100:00100000:0.0:1788863742.425959:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:2409:x1875759205542016:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863742.425980:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863742.425988:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 20 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.426002:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 20 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.426026:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863742.426032:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.426042:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.426049:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.426111:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863742.426163:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:2409:x1875759205542016:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 205us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863742.426171:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 88 00010000:00010000:3.0:1788863742.426526:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b69898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251880ef expref: 19 pid: 12972 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.426544:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226574976:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863742.426565:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.426574:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.426579:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.426773:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.426787:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.426794:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.426834:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.426848:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 19 pid: 6538 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.426860:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226575104:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863742.426936:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6763023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863742.428774:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226575104:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863742.428800:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863742.429198:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.429450:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205542144 00000100:00100000:1.0:1788863742.429468:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205542144 00010000:00010000:1.0:1788863742.429505:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 20 pid: 6538 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863742.429580:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 89 00000100:00100000:1.0:1788863742.429590:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:2408:x1875759205542144:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863742.429605:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863742.429611:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 20 pid: 6538 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.429624:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 20 pid: 6538 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.429647:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69a12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188151 expref: 20 pid: 6538 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.429663:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:1.0:1788863742.429668:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.429704:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.429712:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.429738:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863742.429790:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:2408:x1875759205542144:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 202us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.429798:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 89 00010000:00010000:3.0:1788863742.429856:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863742.429864:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863742.429976:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788863742.430116:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788863742.430154:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788863742.430225:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226575232:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788863742.430270:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863742.430296:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863742.430315:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226575232 00000100:00100000:3.0:1788863742.430319:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226575232 00000100:00100000:3.0:1788863742.430349:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788863742.430356:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6536:x1875759226575232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788863742.430426:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6536:x1875759226575232:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.430432:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788863742.430461:0:6536:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788863742.430467:0:6536:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e54418ed80, transno 4294967316 00000100:00100000:3.0:1788863742.430479:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226575232:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788863742.430585:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788863742.430621:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226575360:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788863742.430649:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863742.430664:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863742.434162:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226575360 00000100:00100000:2.0:1788863742.434182:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226575360 00000100:00100000:2.0:1788863742.434242:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788863742.434253:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1875759226575360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788863742.434573:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6536:x1875759226575360:12345-0@lo:1000:mdt00_000.0 Request processed in 321us (3921us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788863742.434582:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788863742.436947:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226575360:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788863742.437013:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437025:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437034:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437040:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863742.437045:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437054:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437072:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:0.0:1788863742.437103:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863742.437108:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437114:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69a51 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437142:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437158:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437166:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437171:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863742.437174:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437180:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437190:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863742.437193:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863742.437197:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437203:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b6998d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437225:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437239:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 22 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437248:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437283:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 22 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.437304:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 22 pid: 10368 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.437319:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226575488:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863742.437421:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863742.441802:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226575488:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863742.441848:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.451445:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863742.451954:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205542272 00000100:00100000:2.0:1788863742.451965:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205542272 00010000:00010000:2.0:1788863742.452007:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 23 pid: 10368 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863742.452066:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:2.0:1788863742.452114:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:2408:x1875759205542272:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863742.452130:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863742.452137:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 23 pid: 10368 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.452151:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 23 pid: 10368 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.452176:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b699a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188135 expref: 23 pid: 10368 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.452193:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:2.0:1788863742.452198:0:10356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.452208:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.452214:0:10356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.452361:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863742.452429:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:2408:x1875759205542272:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 353us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863742.452438:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 90 00010000:00010000:0.0:1788863742.453023:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453032:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453045:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453052:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453059:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453065:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863742.453070:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453169:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453184:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863742.453187:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863742.453192:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453200:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69a58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453213:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453220:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453227:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453298:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259bc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863742.453301:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453308:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453317:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6a500) 00010000:00010000:0.0:1788863742.453319:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863742.453323:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.453340:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69a4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863742.453634:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12368:x1875759205541888:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 31009us (31153us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788863742.453644:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 200 00000020:00080000:0.0:1788863742.453650:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788863742.457378:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863742.457390:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863742.457918:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788863742.457930:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863742.465028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.465383:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205542528 00000100:00100000:1.0:1788863742.465394:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205542528 00000100:00100000:1.0:1788863742.465484:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:1.0:1788863742.465496:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66c697450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12368:x1875759205542528:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788863742.465822:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788863742.465857:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788863742.465894:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.465915:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.465930:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.465940:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.465948:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.465967:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.466201:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863742.466405:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66c697450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:12368:x1875759205542528:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 910us (1390us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788863742.466414:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00000020:00080000:1.0:1788863742.466420:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863742.467196:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863742.467220:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.467289:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863742.467294:0:9549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.467304:0:9549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.467321:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:2.0:1788863742.467325:0:9549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788863742.467330:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863742.467334:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69a5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863742.467558:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863742.467562:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863742.467563:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863742.768555:0:14626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863742.768653:0:14626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863742.768698:0:14626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788863742.768706:0:14626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788863742.975313:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.975388:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205542784 00000100:00100000:1.0:1788863742.975399:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205542784 00000100:00100000:1.0:1788863742.975463:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 201 00000100:00100000:1.0:1788863742.975471:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:12378:x1875759205542784:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863742.975494:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863742.975512:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518816d expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.975630:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69a6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.975645:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69a6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.975658:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69a6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863742.975669:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788863742.975771:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518816d expref: 26 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.975821:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69a6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518816d expref: 25 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.975830:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863742.975833:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863742.975837:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863742.975908:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12378:x1875759205542784:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 437us (605us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788863742.975915:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 201 00000100:00100000:0.0:1788863742.984271:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863742.984356:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205542912 00000100:00100000:1.0:1788863742.984366:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205542912 00000100:00100000:1.0:1788863742.984424:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 202 00000100:00100000:1.0:1788863742.984435:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12378:x1875759205542912:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:1.0:1788863742.984525:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984545:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984557:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984574:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984582:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984604:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984703:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984711:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984718:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863742.984770:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984785:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984792:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984819:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984825:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ee00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863742.984830:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984837:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984851:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863742.984860:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863742.984866:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984873:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69a7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984889:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984894:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984900:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984906:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863742.984908:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984914:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984922:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e643aa2b00) 00010000:00010000:1.0:1788863742.984924:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863742.984927:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984932:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69a82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984948:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984960:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984966:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984971:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863742.984974:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984980:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984988:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:1.0:1788863742.984990:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863742.984993:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863742.984999:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b69a89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863742.985124:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12378:x1875759205542912:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 690us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.985133:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 202 00000100:00100000:0.0:1788863743.072535:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.072775:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205543168 00000100:00100000:0.0:1788863743.072785:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205543168 00000100:00100000:0.0:1788863743.072862:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 203 00000100:00100000:0.0:1788863743.072872:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12382:x1875759205543168:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863743.072893:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863743.072913:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69a90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188174 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073671:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073767:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073781:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073826:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073834:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073841:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073956:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073964:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.073971:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863743.073981:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788863743.074059:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074067:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074088:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074095:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863743.074099:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074116:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074127:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863743.074130:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863743.074134:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074139:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69a97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074151:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074156:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074163:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074168:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863743.074170:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074175:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074182:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a500) 00010000:00010000:0.0:1788863743.074185:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863743.074188:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.074204:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.075380:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69a90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 28 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.075401:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 27 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.075410:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:0.0:1788863743.075413:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863743.075416:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b800, rc 0) 00000100:00100000:0.0:1788863743.075499:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12382:x1875759205543168:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 2627us (2971us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788863743.075508:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 203 00000100:00100000:3.0:1788863743.083279:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.083327:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205543296 00000100:00100000:3.0:1788863743.083337:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205543296 00000100:00100000:3.0:1788863743.083385:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 204 00000100:00100000:3.0:1788863743.083396:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12382:x1875759205543296:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:3.0:1788863743.083468:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083486:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083500:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083537:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083544:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083551:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083570:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167cc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863743.083575:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083583:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083603:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:3.0:1788863743.083606:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863743.083612:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.083618:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ab3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863743.083685:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12382:x1875759205543296:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 292us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.083833:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 204 00000100:00100000:0.0:1788863743.090477:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863743.090544:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205543552 00000100:00100000:2.0:1788863743.090555:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205543552 00000100:00100000:2.0:1788863743.090611:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:2.0:1788863743.090620:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12382:x1875759205543552:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788863743.091271:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:12382:x1875759205543552:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 648us (799us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788863743.091281:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:3.0:1788863743.135503:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.135949:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205543808 00000100:00100000:0.0:1788863743.135961:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205543808 00000100:00100000:0.0:1788863743.136117:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 205 00000100:00100000:0.0:1788863743.136129:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:11914:x1875759205543808:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863743.136157:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863743.136187:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69aba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518817b expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.136311:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.136354:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 29 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.136365:0:10368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.136545:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 29 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.136561:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 29 pid: 6536 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863743.136590:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226575616:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863743.136919:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863743.143356:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226575616:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863743.143389:0:10368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863743.144900:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.146014:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205543936 00000100:00100000:0.0:1788863743.146028:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205543936 00010000:00010000:0.0:1788863743.146154:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 30 pid: 6536 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863743.146390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00100000:0.0:1788863743.146402:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:2409:x1875759205543936:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863743.146420:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863743.146427:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 30 pid: 6536 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.146443:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 30 pid: 6536 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.146468:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69aa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188174 expref: 30 pid: 6536 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.146485:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:0.0:1788863743.146491:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.146520:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.146527:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.146628:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863743.147063:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:2409:x1875759205543936:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 652us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863743.147072:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 91 00010000:00010000:3.0:1788863743.149000:0:10368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.149018:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863743.149043:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788863743.150506:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69aba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 30 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.150533:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 29 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.150541:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:3.0:1788863743.150544:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788863743.150560:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b600, rc 0) 00000100:00100000:3.0:1788863743.151039:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:11914:x1875759205543808:12345-192.168.204.35@tcp:101:bash.0 Request processed in 14909us (15543us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788863743.151048:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 205 00000100:00100000:3.0:1788863743.154361:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.154573:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205544064 00000100:00100000:0.0:1788863743.154584:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205544064 00000100:00100000:0.0:1788863743.154656:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 206 00000100:00100000:0.0:1788863743.154666:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:11914:x1875759205544064:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863743.154700:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863743.154722:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69acf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188182 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.154758:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b69ad6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.154772:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b69ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.154782:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b69ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.154921:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69acf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188182 expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.154957:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b69ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188182 expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.154967:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:0.0:1788863743.154970:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863743.154974:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259aa00, rc 0) 00000100:00100000:0.0:1788863743.155030:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:11914:x1875759205544064:12345-192.168.204.35@tcp:101:bash.0 Request processed in 366us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863743.155039:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 206 00010000:00010000:2.0:1788863743.157389:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863743.159977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.160121:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205544320 00000100:00100000:3.0:1788863743.160131:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205544320 00000100:00100000:2.0:1788863743.160389:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 207 00000100:00100000:2.0:1788863743.160402:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:11914:x1875759205544320:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:2.0:1788863743.160919:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.160941:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.160955:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863743.161005:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1788863743.161032:0:12972:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000452bb609 reply state 000000000ec86a65 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.161045:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.161052:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:2.0:1788863743.161054:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863743.161070:0:12972:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788863743.161533:0:12972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788863743.161987:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:11914:x1875759205544320:12345-192.168.204.35@tcp:36:bash.0 Request processed in 1584us (2198us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788863743.161996:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 207 00000020:00080000:2.0:1788863743.162003:0:12972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788863743.165471:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.165559:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205544448 00000100:00100000:3.0:1788863743.165569:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205544448 00000100:00100000:3.0:1788863743.165736:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 208 00000100:00100000:3.0:1788863743.165759:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+34:11914:x1875759205544448:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863743.165786:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863743.165827:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188189 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.165893:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188189 expref: 35 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.165909:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188189 expref: 35 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.165930:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:3.0:1788863743.165934:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863743.165938:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167cc00, rc 0) 00000100:00100000:3.0:1788863743.166001:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:11914:x1875759205544448:12345-192.168.204.35@tcp:101:bash.0 Request processed in 256us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.166008:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 208 00000100:00100000:2.0:1788863743.171184:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.171301:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205544576 00000100:00100000:0.0:1788863743.171312:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205544576 00000100:00100000:0.0:1788863743.171425:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788863743.171435:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:11914:x1875759205544576:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863743.171453:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863743.171473:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188190 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863743.171498:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fe4fd, atime: 0x6a9fe4fb, ctime: 0x6a9fe4fd, blocks: 0x8 00010000:00010000:0.0:1788863743.171518:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1788863743.171523:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863743.171531:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.171546:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.171594:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b200, rc 0) 00000100:00100000:0.0:1788863743.171672:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:11914:x1875759205544576:12345-192.168.204.35@tcp:101:bash.0 Request processed in 237us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863743.171679:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:1.0:1788863743.175207:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.175307:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205544704 00000100:00100000:0.0:1788863743.175317:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205544704 00002000:00010000:0.0:1788863743.175362:0:8456:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788863743.175366:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e543925c00 with x1875759205544704 ext(0->18446744073709551615) 00002000:00010000:0.0:1788863743.175379:0:8456:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e543925c00. 00000100:00100000:0.0:1788863743.175457:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:0.0:1788863743.175467:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205544704:12345-192.168.204.35@tcp:10:bash.0 00002000:00010000:0.0:1788863743.175785:0:8456:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788863743.175789:0:8456:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788863741 -> 1788863743 00002000:00010000:0.0:1788863743.175802:0:8456:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788863739 -> 1788863739 00002000:00010000:0.0:1788863743.175812:0:8456:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788863741 -> 1788863743 00002000:00010000:0.0:1788863743.175814:0:8456:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788863743.175894:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2411:x1875759205544704:12345-192.168.204.35@tcp:10:bash.0 Request processed in 427us (694us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788863743.175902:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00002000:00010000:0.0:1788863743.175906:0:8456:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788863743.175909:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e543925c00 with x1875759205544704 ext(0->18446744073709551615) 00002000:00010000:0.0:1788863743.175915:0:8456:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e543925c00. 00000100:00100000:1.0:1788863743.298510:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.298665:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205544832 00000100:00100000:3.0:1788863743.298690:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205544832 00000100:00100000:3.0:1788863743.298754:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 209 00000100:00100000:3.0:1788863743.298764:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:12396:x1875759205544832:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:3.0:1788863743.298851:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.298868:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.298880:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.298894:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.298901:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.298908:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.298987:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.298997:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299004:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863743.299049:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299071:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299098:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299105:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299110:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167da00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863743.299114:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299121:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299133:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:3.0:1788863743.299136:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863743.299141:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299146:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69af2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299158:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299163:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299167:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299179:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863743.299182:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299188:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299195:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e675672e00) 00010000:00010000:3.0:1788863743.299198:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863743.299200:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299206:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69af9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299220:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299226:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299231:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299236:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863743.299238:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299243:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299260:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:3.0:1788863743.299262:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863743.299265:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.299271:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863743.299366:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:12396:x1875759205544832:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 602us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.299375:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 209 00000100:00100000:2.0:1788863743.352301:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863743.357396:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205545088 00000100:00100000:1.0:1788863743.357434:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205545088 00000100:00100000:1.0:1788863743.357589:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 210 00000100:00100000:1.0:1788863743.357600:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+35:12399:x1875759205545088:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863743.357623:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863743.357644:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188197 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357720:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357736:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357760:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357775:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357783:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357800:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357920:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357931:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.357937:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863743.357957:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788863743.358046:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358055:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358062:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358067:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863743.358072:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358102:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358114:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863743.358118:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863743.358124:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358131:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358147:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358153:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358168:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358185:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863743.358187:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358193:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358201:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e643aa2300) 00010000:00010000:1.0:1788863743.358203:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863743.358206:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358212:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358253:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188197 expref: 38 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358270:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188197 expref: 37 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.358278:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:1.0:1788863743.358280:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788863743.358283:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ea00, rc 0) 00000100:00100000:1.0:1788863743.358377:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12399:x1875759205545088:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 778us (6087us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788863743.358393:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 210 00000100:00100000:3.0:1788863743.362629:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.376614:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205545216 00000100:00100000:0.0:1788863743.376641:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205545216 00000100:00100000:2.0:1788863743.378044:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 211 00000100:00100000:2.0:1788863743.378065:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12399:x1875759205545216:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:2.0:1788863743.378153:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.382775:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 37 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.382816:0:10368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.382874:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 37 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.382891:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 37 pid: 10368 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863743.382907:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226575744:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863743.383024:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863743.393774:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10368:1875759226575744:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863743.393816:0:10368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863743.393920:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.394012:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205545472 00000100:00100000:3.0:1788863743.394020:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205545472 00000100:00100000:3.0:1788863743.394115:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:3.0:1788863743.394125:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:9933:x1875759205545472:12345-192.168.204.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788863743.394544:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:9933:x1875759205545472:12345-192.168.204.35@tcp:35:ldlm_bl.0 Request processed in 419us (624us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788863743.394570:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:2.0:1788863743.412292:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863743.412989:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205545600 00000100:00100000:1.0:1788863743.413004:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205545600 00010000:00010000:1.0:1788863743.413059:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 39 pid: 10368 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863743.413448:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 92 00000100:00100000:1.0:1788863743.413460:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5441c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:2408:x1875759205545600:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863743.413478:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863743.413485:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 39 pid: 10368 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.413498:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 39 pid: 10368 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.413521:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69ac1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518817b expref: 39 pid: 10368 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.413539:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:1.0:1788863743.413546:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.413556:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.413565:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.413620:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863743.413704:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5441c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:2408:x1875759205545600:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 246us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863743.413712:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 92 00010000:00010000:3.0:1788863743.413801:0:10368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413810:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413850:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413868:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413874:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413880:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863743.413885:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413892:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413901:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:3.0:1788863743.413904:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863743.413908:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.413913:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69b2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863743.413956:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12399:x1875759205545216:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 35900us (51336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.413964:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 211 00000100:00100000:3.0:1788863743.420395:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863743.420991:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205545856 00000100:00100000:2.0:1788863743.421002:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205545856 00000100:00100000:2.0:1788863743.421141:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:2.0:1788863743.421152:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+37:12399:x1875759205545856:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788863743.421413:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12399:x1875759205545856:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 261us (1032us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788863743.421421:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:0.0:1788863743.544326:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863743.544547:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205546112 00000100:00100000:1.0:1788863743.544558:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205546112 00000100:00100000:1.0:1788863743.544618:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 212 00000100:00100000:1.0:1788863743.544629:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+38:12410:x1875759205546112:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:1.0:1788863743.544654:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863743.544689:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518819e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544762:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544778:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544805:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544822:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544830:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544837:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544974:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69b46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544984:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.544992:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863743.545002:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788863743.545115:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545123:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545131:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545136:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863743.545141:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545149:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545162:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863743.545165:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863743.545183:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545203:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69b38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545412:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545418:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545425:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545430:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863743.545433:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545439:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545447:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e643aa2300) 00010000:00010000:1.0:1788863743.545450:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863743.545453:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545459:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b69b3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545502:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f400/0xf569beb9d4b69b31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518819e expref: 41 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545516:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69b46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518819e expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.545531:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:1.0:1788863743.545533:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863743.545536:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ec00, rc 0) 00000100:00100000:1.0:1788863743.545605:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12410:x1875759205546112:12345-192.168.204.35@tcp:101:cat.0 Request processed in 978us (1291us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788863743.545613:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 212 00000100:00100000:1.0:1788863743.556850:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.556902:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205546368 00000100:00100000:0.0:1788863743.556913:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205546368 00000100:00100000:0.0:1788863743.556978:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:0.0:1788863743.556989:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+40:12410:x1875759205546368:12345-192.168.204.35@tcp:35:cat.0 00000100:00100000:0.0:1788863743.557448:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12410:x1875759205546368:12345-192.168.204.35@tcp:35:cat.0 Request processed in 460us (606us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788863743.557456:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:3.0:1788863743.581922:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.582057:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205546624 00000100:00100000:0.0:1788863743.582067:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205546624 00000100:00100000:0.0:1788863743.582156:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00100000:0.0:1788863743.582178:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+41:12411:x1875759205546624:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:0.0:1788863743.582249:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788863743.582277:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69ae4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188189 expref: 41 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582299:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ec00/0xf569beb9d4b69b46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518819e expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582312:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b69b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188197 expref: 39 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582323:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b69ad6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188182 expref: 38 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582333:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:0.0:1788863743.582350:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863743.582372:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582385:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582395:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582409:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582416:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582422:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582508:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582517:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.582524:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863743.583383:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788863743.583397:0:6538:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410707320106ns, next at 411707316078ns, rc = 0 00010000:00010000:0.0:1788863743.583453:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583479:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583489:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583497:0:6538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583503:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583509:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583532:0:6538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863743.583553:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583559:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583565:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583570:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863743.583574:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583581:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583602:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:0.0:1788863743.583605:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788863743.583610:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583616:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a800/0xf569beb9d4b69b62 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583634:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583640:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583646:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583651:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259be00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863743.583654:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583659:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.583666:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863743.583669:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863743.583671:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.583870:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863743.583877:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.583894:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863743.583897:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.583903:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.583912:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:3.0:1788863743.583915:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788863743.583918:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.583923:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69b69 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.583937:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863743.583939:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863743.583941:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863743.583972:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259be00/0xf569beb9d4b69b54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863743.583991:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cae176a2 reply state 00000000a6c81197 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.584002:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.584009:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a100) 00010000:00010000:0.0:1788863743.584011:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863743.584014:0:6538:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863743.584234:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12411:x1875759205546624:12345-192.168.204.35@tcp:36:rm.0 Request processed in 2063us (2317us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788863743.584245:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00100000:0.0:1788863743.658240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.658488:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205546880 00000100:00100000:3.0:1788863743.658499:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205546880 00000100:00100000:3.0:1788863743.658551:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 214 00000100:00100000:3.0:1788863743.658561:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6712a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+39:12417:x1875759205546880:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863743.658588:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863743.658609:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b70 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881a5 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.658730:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.658761:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.658772:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.658794:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.658802:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.658809:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788863743.659212:0:10368:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788863743.659355:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659365:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659372:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659403:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659410:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659417:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659430:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863743.659435:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659442:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659455:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:3.0:1788863743.659457:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863743.659462:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659468:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69b77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863743.659481:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fe75b41 reply state 00000000a8987176 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659491:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659497:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a100) 00010000:00010000:3.0:1788863743.659499:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863743.659502:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788863743.659530:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69b70 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 42 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659544:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 41 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.659562:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e675672e00) 00010000:00010000:3.0:1788863743.659564:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863743.659567:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167cc00, rc 0) 00000100:00100000:3.0:1788863743.659627:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6712a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+42:12417:x1875759205546880:12345-192.168.204.35@tcp:101:bash.0 Request processed in 1066us (1396us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788863743.659635:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 214 00000100:00100000:1.0:1788863743.667595:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.667756:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205547008 00000100:00100000:0.0:1788863743.667766:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205547008 00000100:00100000:0.0:1788863743.667843:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788863743.667853:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2409:x1875759205547008:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863743.667871:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863743.667890:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881ac expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863743.667915:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863743.667934:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1788863743.667938:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863743.667947:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.668328:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.668342:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a800, rc 0) 00000100:00100000:0.0:1788863743.668401:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205547008:12345-192.168.204.35@tcp:101:bash.0 Request processed in 550us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863743.668408:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00080000:3.0:1788863743.668853:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863743.673371:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.673459:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205547136 00000100:00100000:3.0:1788863743.673469:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205547136 00000100:00100000:3.0:1788863743.673525:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788863743.673535:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:12417:x1875759205547136:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863743.673552:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863743.673571:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881b3 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.673604:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 9 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.673613:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863743.673618:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863743.673623:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.673656:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 9 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.673700:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 9 pid: 8452 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863743.673715:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1875759226575872:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863743.673828:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863743.677000:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1875759226575872:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863743.677035:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.677055:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d400, rc 0) 00000100:00100000:3.0:1788863743.677151:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:12417:x1875759205547136:12345-192.168.204.35@tcp:101:bash.0 Request processed in 3617us (3789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.677160:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:1.0:1788863743.680746:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.680903:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205547264 00000100:00100000:0.0:1788863743.680914:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205547264 00010000:00010000:0.0:1788863743.680955:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 9 pid: 8452 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863743.681009:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 93 00000100:00100000:0.0:1788863743.681018:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205547264:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863743.681032:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863743.681053:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 9 pid: 8452 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.681066:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 9 pid: 8452 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.681127:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ff0e6e4/0xf569beb9d4b69b93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ac expref: 9 pid: 8452 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.681165:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863743.681169:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863743.681178:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.681187:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863743.681413:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863743.681429:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6524:1875759226576000:192.168.204.35@tcp:105: 00000100:00100000:0.0:1788863743.681526:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863743.688374:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863743.688465:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205547520 00000100:00100000:1.0:1788863743.688474:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205547520 00000100:00100000:1.0:1788863743.688589:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:1.0:1788863743.688599:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+42:12417:x1875759205547520:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:1.0:1788863743.688934:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+43:12417:x1875759205547520:12345-192.168.204.35@tcp:35:bash.0 Request processed in 336us (570us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788863743.688942:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:3.0:1788863743.689370:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6524:1875759226576000:192.168.204.35@tcp:105: 00010000:00010000:3.0:1788863743.689394:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863743.689437:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205547264:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 8420us (8701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.689446:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 93 00000100:00100000:0.0:1788863743.920620:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863743.920839:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205547648 00000100:00100000:2.0:1788863743.920851:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205547648 00000100:00100000:2.0:1788863743.920921:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 215 00000100:00100000:2.0:1788863743.920932:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+43:12433:x1875759205547648:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863743.920958:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863743.920979:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69ba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881ba expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.921041:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69ba8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.921056:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.921071:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863743.921162:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788863743.921176:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863743.921201:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.921227:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69ba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ba expref: 45 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.921258:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ba expref: 44 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.921267:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863743.921271:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863743.921275:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537c00, rc 0) 00000100:00100000:2.0:1788863743.921337:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+44:12433:x1875759205547648:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 407us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863743.921345:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 215 00000100:00100000:0.0:1788863743.928024:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.928790:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205547904 00000100:00100000:3.0:1788863743.928803:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205547904 00000100:00100000:3.0:1788863743.928879:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 216 00000100:00100000:3.0:1788863743.928890:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+44:12433:x1875759205547904:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863743.928914:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863743.928950:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69baf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881c1 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.929058:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69bb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.929072:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.929132:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863743.929145:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788863743.929764:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69baf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881c1 expref: 47 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.929797:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881c1 expref: 46 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.929806:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e675672e00) 00010000:00010000:3.0:1788863743.929809:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863743.929812:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030800, rc 0) 00000100:00100000:3.0:1788863743.929877:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:12433:x1875759205547904:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 989us (1863us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788863743.929886:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 216 00000100:00100000:0.0:1788863743.936905:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863743.937028:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.937138:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205548288 00000100:00100000:3.0:1788863743.937149:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205548288 00000100:00100000:3.0:1788863743.937218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788863743.937227:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+46:2411:x1875759205548288:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863743.937272:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863743.937298:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69bb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881c1 expref: 46 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.937319:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e675672e00) 00010000:00010000:3.0:1788863743.937325:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863743.937392:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:2411:x1875759205548288:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 166us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.937399:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1788863743.941009:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205548160 00000100:00100000:1.0:1788863743.941024:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205548160 00000100:00100000:1.0:1788863743.941179:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 217 00000100:00100000:1.0:1788863743.941191:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+45:12433:x1875759205548160:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863743.941216:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863743.941238:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69bc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881c8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.941366:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69bcb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.941405:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69bcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.941417:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69bcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863743.941430:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788863743.941556:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69bc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881c8 expref: 48 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.941575:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69bcb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881c8 expref: 47 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.941585:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e675672e00) 00010000:00010000:1.0:1788863743.941588:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863743.941591:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ee00, rc 0) 00000100:00100000:1.0:1788863743.941660:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+47:12433:x1875759205548160:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 471us (4766us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788863743.942024:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 217 00000100:00100000:0.0:1788863743.962436:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863743.962701:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205548416 00000100:00100000:3.0:1788863743.962713:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205548416 00000100:00100000:3.0:1788863743.962770:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788863743.962793:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205548416:12345-192.168.204.35@tcp:1:lfs.0 00010000:00010000:3.0:1788863743.962836:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.962857:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.962867:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788863743.962871:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863743.962876:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.962910:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.962946:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 8 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863743.962961:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1875759226576128:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863743.963320:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863743.974788:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1875759226576128:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863743.974819:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863743.974967:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863743.975099:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205548544 00000100:00100000:2.0:1788863743.975107:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205548544 00002000:00100000:2.0:1788863743.975157:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff89e543b79880 x1875759205548544/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:729/0 lens 504/0 e 0 to 0 dl 1788863754 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863743.975168:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e543b79880 with x1875759205548544 ext(0->8) 00010000:00010000:2.0:1788863743.975175:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 9 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.975190:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 9 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863743.975198:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89e543b79880 00000100:00100000:2.0:1788863743.975252:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:2.0:1788863743.975262:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2408:x1875759205548544:12345-192.168.204.35@tcp:4:lfs.0 00000100:00100000:2.0:1788863743.979739:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2408:x1875759205548544:12345-192.168.204.35@tcp:4:lfs.0 Request processed in 4463us (4759us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788863743.979755:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00002000:00100000:2.0:1788863743.979770:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff89e543b79880 x1875759205548544/t4294967309(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:729/0 lens 504/448 e 0 to 0 dl 1788863754 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863743.979792:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e543b79880 with x1875759205548544 ext(0->8) 00010000:00010000:2.0:1788863743.979803:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 11 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863743.979826:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 11 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863743.979834:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89e543b79880 00000100:00100000:0.0:1788863743.986194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863743.988027:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205548672 00000100:00100000:1.0:1788863743.988041:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205548672 00010000:00010000:1.0:1788863743.988131:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 11 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863743.988183:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 94 00000100:00100000:1.0:1788863743.988206:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2409:x1875759205548672:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863743.988225:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788863743.988260:0:6522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788863743.988263:0:6522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788863744 00002000:00010000:1.0:1788863743.988265:0:6522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788863744 00002000:00010000:1.0:1788863743.988267:0:6522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788863744 00002000:00010000:1.0:1788863743.988270:0:6522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788863743.988277:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 11 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.988291:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 11 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.988317:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ada5163/0xf569beb9d4b69b9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881b3 expref: 11 pid: 8450 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.988334:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863743.988338:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863743.988343:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.988352:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863743.988518:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863743.988577:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2409:x1875759205548672:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 384us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863743.988586:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 94 00010000:00010000:3.0:1788863743.990428:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990447:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990480:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990489:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990497:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990528:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863743.990533:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990543:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990564:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863743.990572:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b75811/0xf569beb9d4b69bd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863743.990685:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2411:x1875759205548416:12345-192.168.204.35@tcp:1:lfs.0 Request processed in 27902us (28256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.990695:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:0.0:1788863744.002678:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863744.002773:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205548928 00000100:00100000:2.0:1788863744.002795:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205548928 00000100:00100000:2.0:1788863744.002869:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:2.0:1788863744.002880:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66c694c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+47:12433:x1875759205548928:12345-192.168.204.35@tcp:35:lfs.0 00000004:00010000:2.0:1788863744.002956:0:6540:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69bcb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881c8 expref: 47 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788863744.003290:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788863744.003555:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788863744.003591:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788863744.008346:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788863744.008415:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.008450:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 51 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.008459:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.008501:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 51 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.008518:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 51 pid: 10368 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863744.008533:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6540:1875759226576256:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863744.008766:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863744.023736:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6540:1875759226576256:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863744.023769:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863744.023910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863744.024417:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205549056 00000100:00100000:3.0:1788863744.024426:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205549056 00010000:00010000:3.0:1788863744.024467:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 52 pid: 10368 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863744.024506:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:3.0:1788863744.024515:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+52:2408:x1875759205549056:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863744.024530:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863744.024550:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 52 pid: 10368 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.024562:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 52 pid: 10368 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.024584:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69b85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881a5 expref: 52 pid: 10368 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.024601:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e675672e00) 00010000:00010000:3.0:1788863744.024606:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.024616:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.024623:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.024653:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863744.025327:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.025339:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863744.025450:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788863744.025569:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788863744.026006:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226576384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788863744.026109:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863744.026140:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863744.027416:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+53:2408:x1875759205549056:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 2892us (3498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863744.027430:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:3.0:1788863744.027482:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226576384 00000100:00100000:3.0:1788863744.027490:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226576384 00000100:00100000:3.0:1788863744.027548:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788863744.027557:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6540:x1875759226576384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788863744.027679:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6540:x1875759226576384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863744.027702:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1788863744.027954:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863744.028003:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5441c3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226576384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788863744.028348:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788863744.028444:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226576512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788863744.028485:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863744.028511:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863744.029116:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226576512 00000100:00100000:3.0:1788863744.029125:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226576512 00000100:00100000:3.0:1788863744.029183:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788863744.029192:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6540:x1875759226576512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788863744.029545:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6540:x1875759226576512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 355us (1060us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788863744.029554:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788863744.029647:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875759226576512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788863744.029727:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788863744.029772:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.029795:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.029803:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.029811:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863744.029815:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.029824:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.029842:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e675672e00) 00010000:00010000:0.0:1788863744.029845:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788863744.029849:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.029856:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69be0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863744.029958:0:6540:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788863744.030038:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788863744.030049:0:6540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411153972591ns, next at 412153970584ns, rc = 0 00000001:00080000:0.0:1788863744.030055:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788863744.030117:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e675672e00) 00010000:00010000:0.0:1788863744.030121:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788863744.030134:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69bcb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881c8 expref: 55 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863744.030241:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66c694c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:12433:x1875759205548928:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 27363us (27582us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788863744.030249:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 56 00000020:00080000:0.0:1788863744.030253:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788863744.038756:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863744.038881:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205549184 00000100:00100000:1.0:1788863744.038905:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205549184 00000100:00100000:1.0:1788863744.039416:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 218 00000100:00100000:1.0:1788863744.039427:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+54:12433:x1875759205549184:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863744.039450:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863744.039472:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69be7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881cf expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.039532:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69be7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881cf expref: 55 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.039548:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69be7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881cf expref: 55 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.039569:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:1.0:1788863744.039572:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863744.039576:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fa00, rc 0) 00000100:00100000:1.0:1788863744.039641:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:12433:x1875759205549184:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 216us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863744.039649:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 218 00000100:00100000:1.0:1788863744.044264:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863744.048328:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205549440 00000100:00100000:0.0:1788863744.048347:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205549440 00000100:00100000:0.0:1788863744.048428:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:0.0:1788863744.048440:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+55:12433:x1875759205549440:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788863744.048794:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+56:12433:x1875759205549440:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 355us (4545us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788863744.048803:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 57 00000040:00080000:0.0:1788863744.108417:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863744.171452:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863744.199444:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863744.199640:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205549568 00000100:00100000:2.0:1788863744.199651:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205549568 00000100:00100000:2.0:1788863744.199758:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 219 00000100:00100000:2.0:1788863744.199770:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66c71cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+56:12443:x1875759205549568:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:2.0:1788863744.199865:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.199884:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.199897:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.199908:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.199916:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.199922:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200014:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200022:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200029:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863744.200105:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200118:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200124:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200130:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200137:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863744.200141:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200148:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200159:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863744.200162:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863744.200167:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200179:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69bee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200195:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200200:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200205:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200209:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863744.200212:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200217:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200225:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a100) 00010000:00010000:2.0:1788863744.200227:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863744.200230:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200235:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537a00/0xf569beb9d4b69bf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200244:0:10368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200250:0:10368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200261:0:10368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200266:0:10368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863744.200269:0:10368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200275:0:10368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200283:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863744.200285:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863744.200288:0:10368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.200294:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69bfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863744.200400:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66c71cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+56:12443:x1875759205549568:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 632us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863744.200409:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 219 00000100:00100000:1.0:1788863744.275793:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863744.275996:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205549824 00000100:00100000:3.0:1788863744.276007:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205549824 00000100:00100000:3.0:1788863744.276104:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00100000:3.0:1788863744.276115:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+56:12446:x1875759205549824:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863744.276138:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863744.276158:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881d6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276241:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276258:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276269:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276281:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276293:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276317:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276422:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276431:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276439:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863744.276448:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788863744.276526:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276545:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276552:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276558:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863744.276563:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276570:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276584:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:3.0:1788863744.276587:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863744.276599:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276606:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276621:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276627:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276633:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276637:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167cc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863744.276640:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276645:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.276653:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a100) 00010000:00010000:3.0:1788863744.276654:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863744.277050:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.277061:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.277183:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881d6 expref: 59 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.277222:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881d6 expref: 58 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.277229:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863744.277231:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863744.277233:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d400, rc 0) 00000100:00100000:3.0:1788863744.277309:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+58:12446:x1875759205549824:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1196us (1536us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788863744.277317:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00100000:1.0:1788863744.282455:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863744.284162:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205549952 00000100:00100000:2.0:1788863744.284176:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205549952 00000100:00100000:2.0:1788863744.284248:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 221 00000100:00100000:2.0:1788863744.284259:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+58:12446:x1875759205549952:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:2.0:1788863744.284327:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284346:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284373:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284411:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284418:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284425:0:12972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284431:0:12972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863744.284435:0:12972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284443:0:12972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284455:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863744.284668:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863744.284676:0:12972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.284683:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69c26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863744.284781:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+58:12446:x1875759205549952:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 515us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863744.284789:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 221 00000100:00100000:1.0:1788863744.296137:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863744.296302:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205550208 00000100:00100000:0.0:1788863744.296312:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205550208 00000100:00100000:0.0:1788863744.296369:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:0.0:1788863744.296379:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+58:12446:x1875759205550208:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788863744.296636:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+59:12446:x1875759205550208:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 258us (510us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788863744.296645:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:1.0:1788863744.412907:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863744.413104:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205550464 00000100:00100000:3.0:1788863744.413115:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205550464 00000100:00100000:3.0:1788863744.413197:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 222 00000100:00100000:3.0:1788863744.413209:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+59:12456:x1875759205550464:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863744.413234:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863744.413237:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788863744.413264:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69ba8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881ba expref: 59 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.413283:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:3.0:1788863744.413289:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863744.413302:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c2d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881dd expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.413404:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.413454:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.413465:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863744.413478:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788863744.413598:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881dd expref: 61 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.413614:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881dd expref: 60 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.413622:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863744.413625:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863744.413627:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167da00, rc 0) 00000100:00100000:3.0:1788863744.413753:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:12456:x1875759205550464:12345-192.168.204.35@tcp:101:bash.0 Request processed in 545us (857us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788863744.413761:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 222 00000100:00100000:1.0:1788863744.422798:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863744.422855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863744.422950:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205550592 00000100:00100000:3.0:1788863744.422960:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205550592 00000100:00100000:3.0:1788863744.423047:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 223 00000100:00100000:3.0:1788863744.423058:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:12456:x1875759205550592:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863744.423109:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863744.423131:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881e4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.423190:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.423205:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.423218:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.423349:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69c42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 62 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.423370:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.423379:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863744.423382:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863744.423386:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030800, rc 0) 00000100:00100000:3.0:1788863744.423456:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:12456:x1875759205550592:12345-192.168.204.35@tcp:101:bash.0 Request processed in 400us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863744.423464:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 223 00000100:00100000:2.0:1788863744.423671:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205550720 00000100:00100000:2.0:1788863744.423677:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205550720 00000100:00100000:2.0:1788863744.423724:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:2.0:1788863744.423732:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+61:2408:x1875759205550720:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863744.423743:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863744.423756:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881dd expref: 61 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863744.423784:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863744.423788:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863744.423820:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:2408:x1875759205550720:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 89us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863744.423826:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:1.0:1788863744.434111:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863744.437672:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205550976 00000100:00100000:0.0:1788863744.437688:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205550976 00000100:00100000:0.0:1788863744.437796:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 224 00000100:00100000:0.0:1788863744.437807:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+60:12456:x1875759205550976:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:0.0:1788863744.437863:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863744.437892:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881d6 expref: 60 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.437913:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863744.437919:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863744.438282:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.438379:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.438391:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863744.438434:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788863744.438457:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060232eaf reply state 000000004ceaa0ad transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.438469:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.438476:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863744.438479:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863744.438481:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863744.438576:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:12456:x1875759205550976:12345-192.168.204.35@tcp:36:bash.0 Request processed in 770us (4499us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788863744.438584:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 224 00000020:00080000:0.0:1788863744.438599:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788863744.442595:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863744.442676:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205551104 00000100:00100000:0.0:1788863744.442686:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205551104 00000100:00100000:0.0:1788863744.442742:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 225 00000100:00100000:0.0:1788863744.442750:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+62:12456:x1875759205551104:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863744.442784:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863744.442804:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69c57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881eb expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.442891:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.442905:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.442917:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863744.442942:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788863744.442947:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863744.442965:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.442988:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69c57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 64 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.443004:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 63 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.443013:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863744.443022:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863744.443025:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b800, rc 0) 00000100:00100000:0.0:1788863744.443104:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+63:12456:x1875759205551104:12345-192.168.204.35@tcp:101:bash.0 Request processed in 354us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863744.443111:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 225 00000100:00100000:1.0:1788863744.450960:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863744.451052:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205551360 00000100:00100000:2.0:1788863744.451062:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205551360 00000100:00100000:2.0:1788863744.451143:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:2.0:1788863744.451155:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+63:12456:x1875759205551360:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:2.0:1788863744.451708:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+64:12456:x1875759205551360:12345-192.168.204.35@tcp:35:bash.0 Request processed in 553us (758us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788863744.451717:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 59 00000040:00080000:3.0:1788863744.492450:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863744.492457:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863744.492481:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788863744.492491:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788863744.560861:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863744.561044:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205551488 00000100:00100000:1.0:1788863744.561053:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205551488 00000100:00100000:1.0:1788863744.561138:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 226 00000100:00100000:1.0:1788863744.561147:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+64:12462:x1875759205551488:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863744.561173:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863744.561193:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881f2 expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.561257:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69c6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.561272:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.561284:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863744.561345:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788863744.561349:0:12972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863744.561369:0:12972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.561405:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b69c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f2 expref: 66 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.561425:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f2 expref: 65 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.561434:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863744.561451:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863744.561455:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f200, rc 0) 00000100:00100000:1.0:1788863744.561513:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:12462:x1875759205551488:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 366us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863744.561520:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 226 00000100:00100000:1.0:1788863744.566194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863744.566320:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205551616 00000100:00100000:0.0:1788863744.566336:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205551616 00000100:00100000:0.0:1788863744.566394:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 227 00000100:00100000:0.0:1788863744.566403:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:12462:x1875759205551616:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863744.566423:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863744.566441:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69c73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251881f9 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566500:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566514:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566535:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566546:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566553:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566560:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566644:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566975:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.566986:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863744.567036:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788863744.567040:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863744.567056:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567068:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567110:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567118:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567125:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567131:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863744.567136:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567143:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567165:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:0.0:1788863744.567168:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863744.567173:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567179:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b600/0xf569beb9d4b69c7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567194:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567200:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567207:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567213:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259bc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863744.567216:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567221:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567228:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a100) 00010000:00010000:0.0:1788863744.567230:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863744.567232:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567238:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69c81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567277:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a000/0xf569beb9d4b69c73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 67 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567436:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.567445:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863744.567448:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863744.567450:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863744.567516:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12462:x1875759205551616:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1114us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863744.567632:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 227 00000100:00100000:1.0:1788863744.577057:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863744.577926:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205551872 00000100:00100000:3.0:1788863744.577938:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205551872 00000100:00100000:3.0:1788863744.578066:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 228 00000100:00100000:3.0:1788863744.578109:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12462:x1875759205551872:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863744.578131:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863744.578152:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188200 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.578285:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.578301:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 67 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.578309:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 67 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.578317:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.578363:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 67 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.578378:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 67 pid: 6536 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863744.578393:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226576640:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863744.578507:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 67 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.578516:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 67 pid: 6538 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863744.578546:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f805180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226576768:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863744.578570:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863744.579936:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863744.580701:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205552000 00000100:00100000:0.0:1788863744.580712:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205552000 00010000:00010000:0.0:1788863744.580756:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 68 pid: 6536 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863744.580807:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 96 00000100:00100000:0.0:1788863744.580817:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:2408:x1875759205552000:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863744.580831:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863744.580838:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 68 pid: 6536 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.580852:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 68 pid: 6536 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.580892:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863744.580897:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.580905:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.580912:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863744.580978:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:2408:x1875759205552000:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 162us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863744.580986:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 96 00010000:00010000:1.0:1788863744.596208:0:6537:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.35@tcp) returned -22 from blocking AST (req@00000000be2210da x1875759226576640) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 67 pid: 6536 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.596236:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69c88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f9 expref: 67 pid: 6536 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863744.596256:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226576640:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863744.596272:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f805180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226576768:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863744.596622:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:1.0:1788863744.596629:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.597150:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.597164:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863744.598843:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863744.599468:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205552128 00000100:00100000:3.0:1788863744.599479:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205552128 00010000:00010000:3.0:1788863744.599520:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 67 pid: 6538 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863744.599640:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 97 00000100:00100000:3.0:1788863744.599722:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:2409:x1875759205552128:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863744.599744:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863744.599754:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 67 pid: 6538 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.599779:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 67 pid: 6538 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.599802:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b800/0xf569beb9d4b69c5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881eb expref: 67 pid: 6538 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.599820:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863744.599827:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.599836:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.599861:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.599894:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863744.600020:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.600040:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863744.600060:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788863744.601037:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b69c8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 68 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.601061:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 67 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.601070:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:1.0:1788863744.601073:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863744.602158:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167d400, rc 0) 00000100:00100000:1.0:1788863744.602855:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:12462:x1875759205551872:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 24744us (25804us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788863744.605415:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 228 00000100:00100000:3.0:1788863744.609797:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:2409:x1875759205552128:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 10133us (10947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863744.609814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 97 00000100:00100000:3.0:1788863744.620802:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863744.621214:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205552384 00000100:00100000:1.0:1788863744.621225:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205552384 00000100:00100000:1.0:1788863744.621360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:1.0:1788863744.621372:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12462:x1875759205552384:12345-192.168.204.35@tcp:103:lfs.0 00010000:00010000:1.0:1788863744.621391:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863744.621420:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b69be7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881cf expref: 66 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863744.621442:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:1.0:1788863744.621447:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863744.621588:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:12462:x1875759205552384:12345-192.168.204.35@tcp:103:lfs.0 Request processed in 218us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863744.621596:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:0.0:1788863744.633470:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863744.634228:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205552512 00000100:00100000:3.0:1788863744.634241:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205552512 00000100:00100000:3.0:1788863744.634750:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 229 00000100:00100000:3.0:1788863744.634773:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:12462:x1875759205552512:12345-192.168.204.35@tcp:58:lfs.0 00010000:00010000:3.0:1788863744.634918:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.634940:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863744.634951:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863744.635050:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788863744.635968:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:12462:x1875759205552512:12345-192.168.204.35@tcp:58:lfs.0 Request processed in 1202us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863744.635979:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 229 00000100:00100000:2.0:1788863744.644522:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863744.644809:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205552640 00000100:00100000:0.0:1788863744.644819:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205552640 00000100:00100000:0.0:1788863744.644933:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 230 00000100:00100000:0.0:1788863744.644944:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+65:12462:x1875759205552640:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863744.644965:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863744.644986:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188207 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.645041:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.645052:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.645070:0:6536:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.645129:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.645142:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863744.645145:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863744.645149:0:6536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863744.645156:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259bc00, rc 0) 00000100:00100000:0.0:1788863744.645211:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12462:x1875759205552640:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 268us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863744.645218:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 230 00000100:00100000:3.0:1788863745.005026:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863745.005059:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226576896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863745.006325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788863745.006420:0:8603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412130340470ns, next at 413130336575ns, rc = 0 00000100:00100000:0.0:1788863745.006466:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226577024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863745.006551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863745.006718:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226576896 00000100:00100000:1.0:1788863745.006731:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226576896 00000100:00100000:1.0:1788863745.006814:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577024 00000100:00100000:1.0:1788863745.006818:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577024 00000100:00100000:1.0:1788863745.006839:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788863745.006851:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226576896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863745.006899:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788863745.006982:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226576896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.006990:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788863745.007015:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788863745.007023:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226577024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863745.007036:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788863745.007098:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226577024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.007116:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788863745.007478:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863745.008373:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226576896:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1788863745.012184:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788863745.012200:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788863745.013404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226577024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788863745.198056:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863745.515823:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226577408:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.515967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.516065:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226577920:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.516136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.516189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226578432:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.516222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863745.516277:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.516317:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.516338:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.516362:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.516381:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.516398:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.516424:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788863745.516430:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.516438:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226577280:0@lo:400:kworker.0 00000100:00100000:3.0:1788863745.516466:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205552768 00000100:00100000:3.0:1788863745.516478:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205552768 00000100:00100000:2.0:1788863745.516484:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.516506:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226577792:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.516543:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863745.516550:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 394 00000100:00100000:3.0:1788863745.516568:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205552768:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863745.516576:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226578304:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.516605:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863745.516721:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226578432 00000100:00100000:0.0:1788863745.516728:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226578432 00000100:00100000:1.0:1788863745.516779:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577408 00000100:00100000:1.0:1788863745.516788:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577408 00000100:00100000:1.0:1788863745.516832:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788863745.516840:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226577408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863745.517121:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205553152 00000100:00100000:0.0:1788863745.517128:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205553152 00000100:00100000:0.0:1788863745.517158:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205553280 00000100:00100000:0.0:1788863745.517162:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205553280 00000100:00100000:0.0:1788863745.517176:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226578304 00000100:00100000:0.0:1788863745.517178:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226578304 00000100:00100000:0.0:1788863745.517194:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788863745.517202:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226578432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863745.517385:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2411:x1875759205552768:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 823us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863745.517394:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 394 00000100:00100000:3.0:1788863745.517438:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:3.0:1788863745.517445:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2411:x1875759205553152:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863745.523616:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226577152:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.523713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.523785:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226577664:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.523823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.523995:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226578176:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.524028:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.524051:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788863745.524059:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226577536:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.524109:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.524126:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226578048:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.524145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.524824:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577664 00000100:00100000:2.0:1788863745.524991:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577664 00000100:00100000:2.0:1788863745.525069:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788863745.525258:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226577664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.525640:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226577408:12345-0@lo:400:kworker.0 Request processed in 8797us (9670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.525651:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788863745.525711:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577152 00000100:00100000:1.0:1788863745.525718:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577152 00000100:00100000:1.0:1788863745.525765:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788863745.525771:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226577152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.525824:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3643:x1875759226577152:12345-0@lo:400:kworker.0 Request processed in 51us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.525830:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788863745.526548:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:1.0:1788863745.526562:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205553280:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863745.526637:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205553280:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 79us (10237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.526643:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:1.0:1788863745.526667:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788863745.526675:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226578304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.526717:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226578304:12345-0@lo:400:kworker.0 Request processed in 45us (10113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.526723:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788863745.526839:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226577152:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.527022:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226577664:12345-0@lo:400:kworker.0 Request processed in 1943us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.527031:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788863745.527105:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226577664:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.528685:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577920 00000100:00100000:2.0:1788863745.528705:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577920 00000100:00100000:2.0:1788863745.528785:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205552896 00000100:00100000:2.0:1788863745.528790:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205552896 00000100:00100000:2.0:1788863745.528811:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205553408 00000100:00100000:2.0:1788863745.528814:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205553408 00000100:00100000:2.0:1788863745.528834:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205553024 00000100:00100000:2.0:1788863745.528837:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205553024 00000100:00100000:2.0:1788863745.528851:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205553536 00000100:00100000:2.0:1788863745.528854:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205553536 00000100:00100000:2.0:1788863745.528866:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577280 00000100:00100000:1.0:1788863745.529039:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226578304:0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.529059:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226577408:0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.529110:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577792 00000100:00100000:1.0:1788863745.529115:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577792 00000100:00100000:1.0:1788863745.529138:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226578176 00000100:00100000:1.0:1788863745.529141:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226578176 00000100:00100000:2.0:1788863745.529570:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577280 00000100:00100000:2.0:1788863745.529594:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226577536 00000100:00100000:2.0:1788863745.529596:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226577536 00000100:00100000:2.0:1788863745.529607:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226578048 00000100:00100000:2.0:1788863745.529610:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226578048 00000100:00100000:2.0:1788863745.529629:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788863745.529673:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 353 00000100:00100000:1.0:1788863745.529700:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:2411:x1875759205552896:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863745.529836:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:2411:x1875759205552896:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 137us (13568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.529845:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 353 00000100:00100000:0.0:1788863745.531101:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226578432:12345-0@lo:400:kworker.0 Request processed in 13891us (14868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863745.531132:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788863745.531188:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863745.531193:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863745.531478:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 354 00000100:00100000:1.0:1788863745.531498:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205553408:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863745.531512:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2411:x1875759205553152:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 14057us (15184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863745.531524:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:1.0:1788863745.531578:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205553408:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 85us (15235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.531587:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 354 00000100:00100000:1.0:1788863745.531622:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 355 00000040:00080000:3.0:1788863745.531847:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863745.531853:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863745.531899:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788863745.531906:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788863745.532037:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f805c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226578560:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863745.532146:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6763020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863745.532184:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 356 00000100:00100000:2.0:1788863745.533799:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226577920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.533933:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226577920:12345-0@lo:400:kworker.0 Request processed in 4296us (17796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.533950:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788863745.533990:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788863745.537382:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226577792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.537544:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226577792:12345-0@lo:400:kworker.0 Request processed in 201us (21004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.537555:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788863745.537612:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788863745.537622:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226577280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.537661:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226577280:12345-0@lo:400:kworker.0 Request processed in 40us (21181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.537668:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788863745.537688:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788863745.537696:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226577536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788863745.537707:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863745.537718:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863745.537802:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226577280:0@lo:400:kworker.0 00000100:00100000:2.0:1788863745.538971:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226577536:12345-0@lo:400:kworker.0 Request processed in 1267us (14852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.538984:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788863745.539068:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226577536:0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.539448:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205553024:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863745.539711:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2411:x1875759205553024:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 8079us (23327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.539719:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 355 00000100:00100000:1.0:1788863745.539787:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788863745.539800:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226578048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.539847:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226578048:12345-0@lo:400:kworker.0 Request processed in 52us (15701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.539853:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788863745.539866:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788863745.539874:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226578176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863745.539905:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226578176:12345-0@lo:400:kworker.0 Request processed in 32us (15876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.539938:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788863745.540447:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226578048:0@lo:400:kworker.0 00010000:00080000:2.0:1788863745.540470:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440ead80 x1875759226578176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863745.540484:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226578176:0@lo:400:kworker.0 00000100:00100000:0.0:1788863745.542348:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226577792:0@lo:400:kworker.0 00010000:00080000:0.0:1788863745.542374:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440e9880 x1875759226577920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863745.542384:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226577920:0@lo:400:kworker.0 00000100:00100000:0.0:1788863745.542396:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788863745.542400:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:0.0:1788863745.542452:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e67f89a300, transno 4294967308 00000004:00080000:0.0:1788863745.542483:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:0.0:1788863745.542497:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226578432:0@lo:400:kworker.0 00000100:00100000:3.0:1788863745.542899:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205553536:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863745.542991:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2411:x1875759205553536:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 10796us (26565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863745.543003:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 356 00000100:00100000:3.0:1788863745.553219:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f805c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226578560:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788863745.570523:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.571400:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205553664 00000100:00100000:2.0:1788863745.571411:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205553664 00000100:00100000:2.0:1788863745.571481:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 231 00000100:00100000:2.0:1788863745.571491:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12463:x1875759205553664:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863745.571523:0:12972:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863745.571777:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12463:x1875759205553664:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 285us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.571785:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 231 00000100:00100000:1.0:1788863745.589059:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.590490:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205553792 00000100:00100000:2.0:1788863745.590503:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205553792 00000100:00100000:2.0:1788863745.590625:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 232 00000100:00100000:2.0:1788863745.590647:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12463:x1875759205553792:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788863745.590726:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590754:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590767:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590782:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590789:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590795:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590818:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590827:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590834:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863745.590894:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788863745.590898:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863745.590912:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590923:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590930:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590937:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590943:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863745.590947:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590954:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590965:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:2.0:1788863745.590968:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863745.590974:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.590980:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69cb2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591005:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591023:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591029:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591033:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863745.591036:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591041:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591048:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff89e54382eb00) 00010000:00010000:2.0:1788863745.591051:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863745.591053:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591058:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69cb9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591071:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591131:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591136:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591141:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863745.591149:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591156:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591405:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863745.591409:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863745.591414:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.591421:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863745.591510:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12463:x1875759205553792:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 Request processed in 875us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.591519:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 232 00000100:00100000:2.0:1788863745.605512:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.605651:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205554048 00000100:00100000:3.0:1788863745.605662:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205554048 00000100:00100000:3.0:1788863745.605727:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 233 00000100:00100000:3.0:1788863745.605737:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+66:12463:x1875759205554048:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863745.605771:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863745.605792:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69cc7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518820e expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.605904:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.605921:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.605933:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863745.605945:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788863745.606029:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606037:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606057:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606062:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863745.606067:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606106:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606128:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863745.606132:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788863745.606137:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606144:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606574:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69cc7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518820e expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606585:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:3.0:1788863745.606587:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863745.606592:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167cc00/0xf569beb9d4b69cc7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518820e expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.606602:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167cc00, rc 0) 00000100:00100000:3.0:1788863745.606715:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:12463:x1875759205554048:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 978us (1212us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1788863745.606732:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 233 00000100:00100000:1.0:1788863745.611403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.611783:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205554176 00000100:00100000:2.0:1788863745.611795:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205554176 00000100:00100000:2.0:1788863745.611896:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 234 00000100:00100000:2.0:1788863745.611908:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:12463:x1875759205554176:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863745.611946:0:12972:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863745.612104:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:12463:x1875759205554176:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 198us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.612122:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 234 00000100:00100000:1.0:1788863745.616979:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.617371:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205554432 00000100:00100000:2.0:1788863745.617383:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205554432 00000100:00100000:2.0:1788863745.617448:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00100000:2.0:1788863745.617458:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:12463:x1875759205554432:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863745.617500:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863745.617503:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788863745.617531:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b69c6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881f2 expref: 67 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.617553:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863745.617558:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863745.617573:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188215 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863745.617984:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788863745.619927:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69ce3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.619950:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.619963:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.620033:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188215 expref: 69 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.620053:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188215 expref: 68 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.620062:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382eb00) 00010000:00010000:2.0:1788863745.620066:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863745.620107:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537200, rc 0) 00000100:00100000:2.0:1788863745.620203:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:12463:x1875759205554432:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 2746us (3232us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788863745.620212:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00100000:0.0:1788863745.629558:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.629654:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205554688 00000100:00100000:3.0:1788863745.629665:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205554688 00000100:00100000:3.0:1788863745.629727:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:3.0:1788863745.629737:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:12463:x1875759205554688:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863745.629807:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863745.629833:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537200/0xf569beb9d4b69ce3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188215 expref: 68 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.629852:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382eb00) 00010000:00010000:3.0:1788863745.629861:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863745.629881:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.629894:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.629902:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.629966:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.629973:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.629980:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630048:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630055:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630061:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630068:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863745.630072:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630108:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630295:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:3.0:1788863745.630298:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863745.630303:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630309:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69cf1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630320:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630326:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630331:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630344:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863745.630346:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630353:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630361:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xb2d38999 (ffff89e675672f00) 00010000:00010000:3.0:1788863745.630363:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863745.630366:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.630372:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69cf8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb2d38999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863745.630469:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:12463:x1875759205554688:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 731us (917us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863745.630477:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:1.0:1788863745.637226:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.637326:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205554816 00000100:00100000:2.0:1788863745.637336:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205554816 00000100:00100000:2.0:1788863745.637395:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00100000:2.0:1788863745.637406:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+67:12463:x1875759205554816:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863745.637428:0:12972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863745.637451:0:12972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518821c expref: -99 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.637487:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.637500:0:12972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.637512:0:12972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.637630:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69cff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 69 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.637662:0:12972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 68 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.637672:0:12972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:2.0:1788863745.637675:0:12972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788863745.637684:0:12972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537000, rc 0) 00000100:00100000:2.0:1788863745.637740:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:12463:x1875759205554816:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 336us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.637760:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00100000:1.0:1788863745.650015:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.650107:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205555072 00000100:00100000:2.0:1788863745.650126:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205555072 00000100:00100000:2.0:1788863745.650194:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00100000:2.0:1788863745.650205:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+68:12463:x1875759205555072:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863745.650294:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.650312:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.650325:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863745.650482:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788863745.650533:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029e9fd75 reply state 000000002c656f56 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.650546:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.650553:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:2.0:1788863745.650556:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788863745.650559:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863745.650661:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+70:12463:x1875759205555072:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 458us (655us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788863745.650668:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00100000:0.0:1788863745.654331:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.654656:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205555200 00000100:00100000:3.0:1788863745.654669:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205555200 00000100:00100000:3.0:1788863745.654729:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 239 00000100:00100000:3.0:1788863745.654740:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+70:12463:x1875759205555200:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863745.654773:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863745.654792:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188223 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.654841:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 71 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.654871:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 71 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.654888:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:3.0:1788863745.654891:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863745.654894:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98600, rc 0) 00000100:00100000:3.0:1788863745.654954:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+71:12463:x1875759205555200:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 217us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863745.654960:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 239 00000100:00100000:1.0:1788863745.659607:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.659955:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205555328 00000100:00100000:2.0:1788863745.659965:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205555328 00000100:00100000:2.0:1788863745.660122:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:2.0:1788863745.660133:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2409:x1875759205555328:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788863745.660357:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2409:x1875759205555328:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 226us (759us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788863745.660364:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:1.0:1788863745.668734:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863745.669128:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205555584 00000100:00100000:0.0:1788863745.669140:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205555584 00000100:00100000:0.0:1788863745.669218:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:0.0:1788863745.669229:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+71:12463:x1875759205555584:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788863745.669475:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+72:12463:x1875759205555584:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 247us (753us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788863745.669484:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:1.0:1788863745.679725:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.679842:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205555840 00000100:00100000:2.0:1788863745.679853:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205555840 00000100:00100000:2.0:1788863745.679917:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 240 00000100:00100000:2.0:1788863745.679927:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+72:12463:x1875759205555840:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788863745.680062:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+72:12463:x1875759205555840:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 136us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.680069:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 240 00000100:00100000:3.0:1788863745.690048:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.690919:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205555968 00000100:00100000:2.0:1788863745.690931:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205555968 00000100:00100000:2.0:1788863745.690997:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 241 00000100:00100000:2.0:1788863745.691008:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+72:12463:x1875759205555968:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863745.691029:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863745.691050:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518822a expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.691500:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.691519:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.691550:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863745.691598:0:10368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863745.691618:0:10368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.692013:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518822a expref: 74 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.692033:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518822a expref: 73 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.692042:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:2.0:1788863745.692045:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788863745.692048:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537e00, rc 0) 00000100:00100000:2.0:1788863745.692338:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+73:12463:x1875759205555968:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 1331us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.692347:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 241 00000100:00100000:1.0:1788863745.702873:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863745.702991:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205556096 00000100:00100000:0.0:1788863745.703000:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205556096 00000100:00100000:0.0:1788863745.703332:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:0.0:1788863745.703343:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+10:2408:x1875759205556096:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863745.703363:0:8606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863745.703386:0:8606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188231 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863745.703412:0:8606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe502, blocks: 0x0 00010000:00010000:0.0:1788863745.703433:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788863745.703437:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863745.703446:0:8606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 11 pid: 8606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.703462:0:8606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 11 pid: 8606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.703474:0:8606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b000, rc 0) 00000100:00100000:0.0:1788863745.703545:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2408:x1875759205556096:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 203us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863745.703552:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:1.0:1788863745.713204:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.713313:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205556352 00000100:00100000:2.0:1788863745.713323:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205556352 00000100:00100000:2.0:1788863745.713389:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 242 00000100:00100000:2.0:1788863745.713399:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+73:12463:x1875759205556352:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788863745.713519:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+73:12463:x1875759205556352:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.713527:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 242 00000100:00100000:3.0:1788863745.725023:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863745.725768:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205556480 00000100:00100000:0.0:1788863745.725779:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205556480 00000100:00100000:0.0:1788863745.725842:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:0.0:1788863745.725852:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:12463:x1875759205556480:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863745.725870:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863745.725902:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188238 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.725938:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 12 pid: 8606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.725948:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863745.725952:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863745.725957:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.725994:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 12 pid: 8606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.726007:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 12 pid: 8606 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.726022:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1875759226578688:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863745.726167:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863745.731132:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.731264:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205556608 00000100:00100000:1.0:1788863745.731274:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205556608 00010000:00010000:1.0:1788863745.731317:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 13 pid: 8606 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863745.731366:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00100000:1.0:1788863745.731376:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e449050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:2408:x1875759205556608:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863745.731391:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863745.731411:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 13 pid: 8606 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.731425:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 13 pid: 8606 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.731468:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863745.731473:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863745.731484:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.731494:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.731534:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863745.731554:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6523:1875759226578816:192.168.204.35@tcp:105: 00000100:00100000:1.0:1788863745.731638:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e661f31780 going to sleep for 11 seconds 00010000:00010000:0.0:1788863745.732140:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f567bae/0xf569beb9d4b69d29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188231 expref: 13 pid: 8606 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.732156:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1875759226578688:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863745.732179:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.732203:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a400, rc 0) 00000100:00100000:0.0:1788863745.732244:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:12463:x1875759205556480:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 6394us (7234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863745.732252:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:1.0:1788863745.738999:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6523:1875759226578816:192.168.204.35@tcp:105: 00010000:00010000:1.0:1788863745.739026:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863745.739315:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e449050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2408:x1875759205556608:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 7938us (8189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.739326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00100000:3.0:1788863745.756547:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863745.757128:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205556736 00000100:00100000:0.0:1788863745.757140:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205556736 00002000:00100000:0.0:1788863745.757207:0:8456:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff89e67f805880 x1875759205556736/t0(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:731/0 lens 504/0 e 0 to 0 dl 1788863756 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863745.757218:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e67f805880 with x1875759205556736 ext(0->12) 00002000:00010000:0.0:1788863745.757225:0:8456:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e67f805880 00000100:00100000:0.0:1788863745.757251:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:0.0:1788863745.757261:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+11:2411:x1875759205556736:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788863745.758621:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:2411:x1875759205556736:12345-192.168.204.35@tcp:4:lhsmtool_posix.0 Request processed in 1354us (2077us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788863745.760384:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00002000:00100000:0.0:1788863745.760405:0:8456:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff89e67f805880 x1875759205556736/t4294967321(0) o4->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:731/0 lens 504/448 e 0 to 0 dl 1788863756 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863745.760418:0:8456:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e67f805880 with x1875759205556736 ext(0->12) 00002000:00010000:0.0:1788863745.760426:0:8456:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e67f805880 00000100:00100000:3.0:1788863745.773137:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863745.775390:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205556864 00000100:00100000:0.0:1788863745.775405:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205556864 00000100:00100000:0.0:1788863745.775494:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:0.0:1788863745.775505:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+73:12463:x1875759205556864:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788863745.779991:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788863745.780016:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00010000:00010000:0.0:1788863745.780148:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780170:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780179:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780185:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167c200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.780190:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780198:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780215:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff89e643aa2f00) 00010000:00010000:0.0:1788863745.780218:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863745.780223:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780230:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167c200/0xf569beb9d4b69a35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780262:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780269:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780274:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780299:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641536600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.780303:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780322:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780331:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff89e681a6ad00) 00010000:00010000:0.0:1788863745.780333:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863745.780337:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780342:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69add lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780361:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780367:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780373:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780378:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ac00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.780381:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780387:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780405:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a100) 00010000:00010000:0.0:1788863745.780408:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863745.780411:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780417:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ac00/0xf569beb9d4b69b5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780430:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780437:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780442:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780447:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.780450:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780456:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780463:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e681a6a100) 00010000:00010000:0.0:1788863745.780465:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863745.780468:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780473:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b69b7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780497:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780504:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780509:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780514:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.780517:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780523:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780531:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863745.780534:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863745.780536:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780542:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b400/0xf569beb9d4b69c50 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780552:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780559:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780564:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780577:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.780580:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780585:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780594:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:0.0:1788863745.780596:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788863745.780599:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.780605:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69d0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863745.780804:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788863745.780829:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e543bd5480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788863745.780833:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e54286e600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e543bd50c0 00000020:00080000:1.0:1788863745.780836:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e54286e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e544038e00 00000004:00080000:1.0:1788863745.780870:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1788863745.780983:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863745.781007:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226578944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788863745.781100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863745.781164:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226578944 00000100:00100000:2.0:1788863745.781171:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226578944 00000100:00100000:2.0:1788863745.781216:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863745.781225:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226578944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788863745.781251:0:14490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1788863745.781283:0:14490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fe500, atime: 0x6a9fe500, ctime: 0x6a9fe500, blocks: 0x8 00010000:00010000:2.0:1788863745.781290:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781304:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1788863745.781322:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863745.781327:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781344:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781353:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781359:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781378:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863745.781390:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863745.781400:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781407:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537c00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863745.781411:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781417:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781431:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781437:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec5faa47/0xf569beb9d4b69d37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.781452:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863745.781453:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863745.781455:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863745.781608:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226578944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 383us (530us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788863745.781616:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:2.0:1788863745.781655:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e543612680/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788863745.781661:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226578944:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788863745.781813:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788863745.785450:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863745.785476:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226579072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788863745.785565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863745.786042:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226579072 00000100:00100000:3.0:1788863745.786051:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226579072 00000100:00100000:2.0:1788863745.786519:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788863745.786532:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226579072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788863745.786565:0:8606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1788863745.786603:0:8606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.786628:0:8606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 12 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.786650:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788863745.786655:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863745.786661:0:8606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.786696:0:8606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 12 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.786711:0:8606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 12 pid: 8451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863745.786725:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8606:1875759226579200:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863745.786821:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863745.790815:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8606:1875759226579200:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863745.790846:0:8606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863745.792841:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000020:00080000:1.0:1788863745.793678:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e676302480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788863745.793684:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e543b6d700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e676302f00 00000020:00080000:1.0:1788863745.793688:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e543b6d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e543b28c00 00000020:00080000:1.0:1788863745.794779:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788863745.794874:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788863745.796137:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205556992 00000100:00100000:0.0:1788863745.796149:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205556992 00010000:00010000:0.0:1788863745.796189:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 13 pid: 8451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.796230:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:0.0:1788863745.796238:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+13:2409:x1875759205556992:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863745.796254:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863745.796259:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 13 pid: 8451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796287:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 13 pid: 8451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796312:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf6d586b/0xf569beb9d4b69aeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188190 expref: 13 pid: 8451 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796329:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863745.796333:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863745.796339:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796349:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796382:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863745.796443:0:8606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.796455:0:8606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.796457:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:2409:x1875759205556992:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 217us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863745.796472:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 99 00010000:00010000:1.0:1788863745.796487:0:8606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.796500:0:8606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.796532:0:8606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863745.796538:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863745.796546:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796554:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537a00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863745.796559:0:9549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796579:0:9549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796592:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796601:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b083ed/0xf569beb9d4b69d3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.796623:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863745.796625:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863745.796626:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863745.796694:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12463:x1875759205556864:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 Request processed in 21190us (23565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863745.796704:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:1.0:1788863745.796711:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226579072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10181us (11145us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788863745.796720:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1788863745.796995:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e67f807800/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788863745.797015:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226579072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788863745.806476:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.806577:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205557120 00000100:00100000:1.0:1788863745.806587:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205557120 00000100:00100000:1.0:1788863745.806644:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:1.0:1788863745.806653:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+12:2410:x1875759205557120:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788863745.808895:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788863745.808909:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1788863745.818483:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2410:x1875759205557120:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 Request processed in 11818us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863745.818499:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:3.0:1788863745.823266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.823888:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205557376 00000100:00100000:2.0:1788863745.823900:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205557376 00000100:00100000:2.0:1788863745.823970:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 244 00000100:00100000:2.0:1788863745.823981:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12463:x1875759205557376:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863745.824116:0:10368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863745.824147:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518822a expref: 21 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.824168:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:2.0:1788863745.824174:0:10368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863745.824204:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.824232:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.824243:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863745.824384:0:10368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000052e43cf reply state 000000007d382a76 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.824396:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.824403:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:2.0:1788863745.824406:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863745.824409:0:10368:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863745.824927:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:12463:x1875759205557376:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 946us (1668us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788863745.824936:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 244 00000100:00100000:3.0:1788863745.830583:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863745.830780:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205557504 00000100:00100000:0.0:1788863745.830791:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205557504 00000100:00100000:0.0:1788863745.830854:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:0.0:1788863745.830865:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205557504:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788863745.831053:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788863745.831057:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788863744 00002000:00010000:0.0:1788863745.831059:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788863744 00002000:00010000:0.0:1788863745.831061:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788863746 -> 1788863744 00002000:00010000:0.0:1788863745.831098:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788863745.831168:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2408:x1875759205557504:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 304us (593us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788863745.831177:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:0.0:1788863745.835280:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.835362:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205557760 00000100:00100000:1.0:1788863745.835375:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205557760 00000100:00100000:1.0:1788863745.835443:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:1.0:1788863745.835453:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:12463:x1875759205557760:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788863745.835526:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.835543:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 22 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.835554:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.835589:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 22 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.835603:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 22 pid: 12972 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863745.835617:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226579328:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863745.835719:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e659945780 going to sleep for 11 seconds 00000100:00100000:1.0:1788863745.839858:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226579328:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863745.839890:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.841840:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.842126:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205557888 00000100:00100000:1.0:1788863745.842136:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205557888 00010000:00010000:1.0:1788863745.842178:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 23 pid: 12972 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863745.842217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 100 00000100:00100000:1.0:1788863745.842227:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+23:2408:x1875759205557888:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863745.842240:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863745.842247:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 23 pid: 12972 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.842259:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 23 pid: 12972 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.842281:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537000/0xf569beb9d4b69d06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518821c expref: 23 pid: 12972 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.842297:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:1.0:1788863745.842302:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.842324:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.842331:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.842359:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863745.842425:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:2408:x1875759205557888:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 200us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.842433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 100 00010000:00010000:3.0:1788863745.842819:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842827:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842874:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842882:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842889:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842894:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863745.842898:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842905:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842915:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:3.0:1788863745.842918:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788863745.842922:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.842928:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b69d4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863745.842994:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12463:x1875759205557760:12345-192.168.204.35@tcp:55:lhsmtool_posix.0 Request processed in 7543us (7724us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788863745.843003:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 245 00000100:00100000:0.0:1788863745.849315:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.849655:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205558016 00000100:00100000:1.0:1788863745.849667:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205558016 00000100:00100000:1.0:1788863745.849726:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:1.0:1788863745.849736:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205558016:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788863745.849798:0:8606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.849822:0:8606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.849831:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863745.849836:0:8606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863745.849841:0:8606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.849882:0:8606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.849896:0:8606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 8 pid: 8450 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863745.849911:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8606:1875759226579456:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863745.850020:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e659945780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863745.854686:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.854803:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8606:1875759226579456:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863745.854834:0:8606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863745.854976:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205558144 00000100:00100000:3.0:1788863745.854983:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205558144 00010000:00010000:3.0:1788863745.855019:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 9 pid: 8450 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863745.855292:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 101 00000100:00100000:1.0:1788863745.855460:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+9:2409:x1875759205558144:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863745.855476:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863745.855498:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 9 pid: 8450 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.855512:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 9 pid: 8450 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.855536:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1f4f610/0xf569beb9d4b69d30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188238 expref: 9 pid: 8450 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.855552:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863745.855556:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863745.855561:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.855571:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.855592:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863745.855649:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2409:x1875759205558144:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 347us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.855666:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 101 00010000:00010000:2.0:1788863745.856069:0:8606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856133:0:8606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856155:0:8606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856163:0:8606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856172:0:8606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856179:0:8606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863745.856184:0:8606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856192:0:8606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856205:0:8606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.856213:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b69d53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863745.856293:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2411:x1875759205558016:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 Request processed in 6557us (6998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.856301:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:0.0:1788863745.864781:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.865104:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205558400 00000100:00100000:2.0:1788863745.865123:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205558400 00000100:00100000:2.0:1788863745.865184:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 246 00000100:00100000:2.0:1788863745.865194:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:12463:x1875759205558400:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788863745.865277:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.865295:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 21 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.865317:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.865355:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 21 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.865369:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 21 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863745.865384:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226579584:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863745.865466:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863745.872361:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226579584:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863745.872406:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.876468:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.876716:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205558528 00000100:00100000:2.0:1788863745.876728:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205558528 00010000:00010000:2.0:1788863745.876792:0:10355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 22 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863745.876829:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 102 00000100:00100000:2.0:1788863745.876839:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:2408:x1875759205558528:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863745.876854:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863745.876861:0:10355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 22 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.876875:0:10355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 22 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.876896:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030800/0xf569beb9d4b69c49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251881e4 expref: 22 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.876913:0:10355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863745.876920:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.876930:0:10355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.876938:0:10355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.876963:0:10355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.876998:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863745.877063:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:2408:x1875759205558528:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 225us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.877070:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 102 00010000:00010000:0.0:1788863745.878440:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.878455:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.878662:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.878678:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 21 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.878687:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.878725:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 21 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.878753:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 21 pid: 6538 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.878788:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226579712:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863745.878879:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863745.885720:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226579712:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863745.885768:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.888610:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863745.889612:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205558656 00000100:00100000:2.0:1788863745.889623:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205558656 00010000:00010000:2.0:1788863745.889677:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 22 pid: 6538 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863745.889721:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 103 00000100:00100000:2.0:1788863745.889731:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:2409:x1875759205558656:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863745.889759:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863745.889765:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 22 pid: 6538 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.889779:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 22 pid: 6538 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.889803:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b69d14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188223 expref: 22 pid: 6538 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.889838:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:2.0:1788863745.889843:0:10356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.889853:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.889861:0:10356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863745.889890:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863745.889956:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:2409:x1875759205558656:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 226us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.889963:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 103 00010000:00010000:3.0:1788863745.890538:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.890548:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863745.890667:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788863745.890800:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788863745.890836:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788863745.890911:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226579840:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788863745.890973:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863745.891540:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863745.891599:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226579840 00000100:00100000:2.0:1788863745.891607:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226579840 00000100:00100000:2.0:1788863745.891664:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788863745.891673:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1875759226579840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788863745.891775:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1875759226579840:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.891782:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788863745.891912:0:6536:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1788863745.891917:0:6536:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1788863745.891936:0:6536:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e67f807800, transno 4294967322 00000100:00100000:0.0:1788863745.891956:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226579840:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788863745.892107:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788863745.892174:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226579968:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788863745.892207:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863745.892232:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226579968 00000100:00100000:0.0:1788863745.892236:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226579968 00000100:00100000:0.0:1788863745.892528:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788863745.892537:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6536:x1875759226579968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788863745.892648:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6536:x1875759226579968:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (440us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788863745.892655:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788863745.892676:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863745.892695:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6536:1875759226579968:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788863745.892726:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892736:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892771:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892777:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.892781:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892790:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892806:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:0.0:1788863745.892810:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863745.892814:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892821:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b200/0xf569beb9d4b69d61 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892846:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892852:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892858:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892863:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167da00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863745.892866:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892881:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892889:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:0.0:1788863745.892892:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863745.892899:0:6536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892910:0:6536:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892919:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.892944:0:6536:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863745.892956:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226580096:192.168.204.35@tcp:105: 00000100:00100000:0.0:1788863745.893035:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863745.900483:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.900568:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205558784 00000100:00100000:1.0:1788863745.900578:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205558784 00000100:00100000:1.0:1788863745.900646:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:1.0:1788863745.900656:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12462:x1875759205558784:12345-192.168.204.35@tcp:49:lfs.0 00000100:00100000:1.0:1788863745.900796:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+25:12462:x1875759205558784:12345-192.168.204.35@tcp:49:lfs.0 Request processed in 141us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863745.900804:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:3.0:1788863745.901549:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875759226580096:192.168.204.35@tcp:105: 00010000:00010000:3.0:1788863745.901581:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901592:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167da00/0xf569beb9d4b69ca4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901625:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901650:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901663:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901691:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901696:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901702:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901708:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863745.901712:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901719:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901731:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863745.901734:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863745.901747:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901755:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d68 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901764:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901770:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901776:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901787:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863745.901790:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901796:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901805:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863745.901807:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863745.901810:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.901815:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537e00/0xf569beb9d4b69d5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863745.902016:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:12463:x1875759205558400:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 36822us (37244us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788863745.902024:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 246 00000020:00080000:3.0:1788863745.902030:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788863745.903968:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863745.903976:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863745.904528:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788863745.904542:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863745.909267:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863745.909309:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863745.909384:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205559296 00000100:00100000:1.0:1788863745.909395:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205559296 00000100:00100000:1.0:1788863745.909453:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:1.0:1788863745.909462:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66c696450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+24:12463:x1875759205559296:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788863745.909698:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788863745.909725:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1788863745.909763:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.909779:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.909791:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.909799:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.909806:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.909827:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863745.909848:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863745.909927:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66c696450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12463:x1875759205559296:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 466us (616us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788863745.909934:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000020:00080000:1.0:1788863745.909938:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788863745.910277:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863745.910291:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.910298:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863745.910302:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.910310:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.910323:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:0.0:1788863745.910325:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788863745.910330:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.910336:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b69d6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863745.910347:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863745.910349:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863745.910350:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863745.910761:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205559040 00000100:00100000:2.0:1788863745.910768:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205559040 00000100:00100000:2.0:1788863745.910813:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:2.0:1788863745.910821:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12462:x1875759205559040:12345-192.168.204.35@tcp:58:lfs.0 00000040:00080000:2.0:1788863745.910953:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788863745.911034:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12462:x1875759205559040:12345-192.168.204.35@tcp:58:lfs.0 Request processed in 214us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863745.911051:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 247 00000100:00100000:0.0:1788863745.989585:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863745.991734:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205559424 00000100:00100000:3.0:1788863745.991760:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205559424 00000100:00100000:3.0:1788863745.991845:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 248 00000100:00100000:3.0:1788863745.991856:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+26:12465:x1875759205559424:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863745.991884:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863745.991907:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518823f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.991972:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.992001:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.992015:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.992032:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.992039:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863745.992045:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863746.001367:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863746.001397:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863746.001407:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863746.001460:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863746.001479:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 27 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863746.001495:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226580224:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863746.001644:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863746.007479:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875759226580224:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863746.007513:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863746.012756:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863746.013211:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205559680 00000100:00100000:1.0:1788863746.013223:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205559680 00000100:00100000:1.0:1788863746.013300:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00080000:0.0:1788863746.013393:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863746.013516:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:6186:x1875759205559680:12345-192.168.204.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788863746.013778:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:6186:x1875759205559680:12345-192.168.204.35@tcp:35:ldlm_bl.0 Request processed in 264us (1041us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788863746.024505:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788863746.027606:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863746.027631:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226580352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863746.027705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863746.027861:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226580352 00000100:00100000:1.0:1788863746.027872:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226580352 00000100:00100000:1.0:1788863746.027926:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788863746.027935:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226580352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863746.027968:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788863746.028030:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226580352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863746.028037:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788863746.028271:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226580352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863746.028645:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226580480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863746.028684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863746.028771:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226580480 00000100:00100000:2.0:1788863746.028777:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226580480 00000100:00100000:2.0:1788863746.028822:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788863746.028830:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226580480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863746.028842:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788863746.028890:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226580480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863746.028896:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788863746.029787:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863746.029835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226580480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863746.039253:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863746.049941:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205559808 00000100:00100000:3.0:1788863746.049957:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205559808 00010000:00010000:3.0:1788863746.050010:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 29 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863746.050474:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 104 00000100:00100000:3.0:1788863746.050487:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:2408:x1875759205559808:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863746.050504:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863746.050512:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 29 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.050548:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 29 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.050570:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167d400/0xf569beb9d4b69c96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188200 expref: 29 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.050592:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863746.050597:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.050607:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.050615:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863746.050807:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863746.050885:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:2408:x1875759205559808:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 401us (11644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863746.050893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 104 00010000:00010000:1.0:1788863746.050964:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.050984:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863746.051040:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788863746.051045:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863746.051067:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051107:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051128:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051135:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051142:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051148:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863746.051152:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051159:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051170:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:1.0:1788863746.051172:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863746.051176:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051192:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98200/0xf569beb9d4b69d7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051204:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051210:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051215:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051221:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863746.051224:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051230:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051237:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff89e675672f00) 00010000:00010000:1.0:1788863746.051240:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863746.051242:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051248:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69d84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051296:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518823f expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051323:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518823f expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.051338:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:1.0:1788863746.051341:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863746.051343:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641536000, rc 0) 00000100:00100000:1.0:1788863746.051375:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12465:x1875759205559424:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 59521us (61802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863746.051383:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 248 00010000:00010000:2.0:1788863746.221281:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863746.539363:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863746.539397:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226580608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863746.539466:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863746.539597:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226580608 00000100:00100000:0.0:1788863746.539615:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226580608 00000100:00100000:0.0:1788863746.539668:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788863746.539679:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226580608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863746.539718:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788863746.539955:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226580608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 277us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863746.539963:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788863746.541038:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863746.541059:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226580736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863746.541142:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863746.541363:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226580736 00000100:00100000:2.0:1788863746.541379:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226580736 00000100:00100000:2.0:1788863746.541432:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788863746.541442:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226580736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863746.541474:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863746.541520:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226580736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863746.541527:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788863746.541585:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226580736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863746.541931:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226580608:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788863746.926306:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863746.926318:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863746.926347:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788863746.926352:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788863746.926515:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226580864:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863746.926623:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863746.937113:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863746.937147:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205559936 00000100:00100000:0.0:1788863746.937156:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205559936 00000100:00100000:0.0:1788863746.937205:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 249 00000100:00100000:0.0:1788863746.937215:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:12476:x1875759205559936:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788863746.937249:0:6536:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788863746.937366:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+28:12476:x1875759205559936:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 152us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863746.937375:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 249 00000100:00100000:2.0:1788863746.937497:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1875759226580864:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788863746.945874:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863746.945954:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205560192 00000100:00100000:3.0:1788863746.945972:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205560192 00000100:00100000:3.0:1788863746.946158:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 250 00000100:00100000:3.0:1788863746.946170:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+27:12476:x1875759205560192:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863746.946310:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863746.946557:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b69d92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188246 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.946680:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.946695:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.946708:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863746.946731:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788863746.946847:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b69d92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188246 expref: 30 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.946864:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188246 expref: 29 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863746.946873:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863746.946876:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863746.946880:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99600, rc 0) 00000100:00100000:3.0:1788863746.946987:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:12476:x1875759205560192:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 819us (1125us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788863746.946995:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 250 00000100:00100000:0.0:1788863746.964577:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863746.964630:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863746.964707:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205560448 00000100:00100000:1.0:1788863746.964729:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205560448 00000100:00100000:1.0:1788863746.964791:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 251 00000100:00100000:1.0:1788863746.964802:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:12476:x1875759205560448:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788863746.964887:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.964906:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.964919:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.965069:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.965103:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.965109:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.965114:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863746.965131:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.965139:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.965153:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:1.0:1788863746.965156:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788863746.965160:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863746.965166:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b69da7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863746.965599:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:12476:x1875759205560448:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 796us (1032us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788863746.965609:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 251 00000100:00100000:2.0:1788863746.966790:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205560576 00000100:00100000:2.0:1788863746.966802:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205560576 00000100:00100000:2.0:1788863746.966867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788863746.966877:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e44a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:2409:x1875759205560576:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863746.966893:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863746.966914:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99600/0xf569beb9d4b69d99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188246 expref: 30 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863746.966930:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863746.966934:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863746.966973:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e44a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:2409:x1875759205560576:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 98us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863746.967001:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000040:00080000:0.0:1788863746.972595:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863746.972610:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863746.973102:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788863746.973112:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863746.976401:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863746.976506:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205560832 00000100:00100000:2.0:1788863746.976520:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205560832 00000100:00100000:2.0:1788863746.976578:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:2.0:1788863746.976588:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+29:12476:x1875759205560832:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788863746.976841:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:12476:x1875759205560832:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 253us (450us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788863746.976849:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000040:00080000:2.0:1788863747.032566:0:14678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863747.032575:0:14678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863747.032605:0:14678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788863747.032611:0:14678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788863747.244294:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863747.274245:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863747.274724:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561088 00000100:00100000:2.0:1788863747.274736:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561088 00000100:00100000:2.0:1788863747.274840:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 252 00000100:00100000:2.0:1788863747.274851:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+30:12489:x1875759205561088:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863747.274888:0:10368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863747.274915:0:10368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69dae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518824d expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863747.275046:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69db5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863747.275061:0:10368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69db5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863747.275106:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69db5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863747.275139:0:10368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788863747.275264:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537400/0xf569beb9d4b69dae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518824d expref: 33 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863747.275284:0:10368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69db5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518824d expref: 32 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863747.275293:0:10368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863747.275296:0:10368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788863747.275300:0:10368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641536600, rc 0) 00000100:00100000:2.0:1788863747.275372:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:12489:x1875759205561088:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 523us (1135us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788863747.275379:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 252 00000100:00100000:2.0:1788863747.278448:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863747.278631:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561216 00000100:00100000:3.0:1788863747.278641:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561216 00000100:00100000:3.0:1788863747.278709:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 253 00000100:00100000:3.0:1788863747.278729:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:12489:x1875759205561216:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:3.0:1788863747.278801:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278820:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278832:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278866:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278873:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278880:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278886:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863747.278890:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278898:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278910:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:3.0:1788863747.278918:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863747.278938:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.278944:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99c00/0xf569beb9d4b69dc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863747.279021:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:12489:x1875759205561216:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 294us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863747.279028:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 253 00000100:00100000:0.0:1788863747.375837:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863747.375938:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561344 00000100:00100000:3.0:1788863747.375950:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561344 00000100:00100000:3.0:1788863747.376031:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:3.0:1788863747.376043:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2410:x1875759205561344:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:3.0:1788863747.376061:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788863747.376401:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788863747.376510:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c61d1f6e/0xf569beb9d4b69dca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188254 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863747.376547:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9fe500, atime: 0x6a9fe500, ctime: 0x6a9fe500, blocks: 0x8 00010000:00010000:3.0:1788863747.376566:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1788863747.376570:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863747.376579:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c61d1f6e/0xf569beb9d4b69dca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188254 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.376594:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c61d1f6e/0xf569beb9d4b69dca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188254 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863747.376607:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99c00, rc 0) 00000100:00100000:3.0:1788863747.376667:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2410:x1875759205561344:12345-192.168.204.35@tcp:101:cat.0 Request processed in 628us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863747.376690:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:0.0:1788863747.384462:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863747.384580:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561472 00000100:00100000:2.0:1788863747.384595:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561472 00002000:00100000:2.0:1788863747.384658:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff89e655c44380 x1875759205561472/t0(0) o3->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:733/0 lens 488/0 e 0 to 0 dl 1788863758 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863747.384679:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e655c44380 with x1875759205561472 ext(0->4095) 00002000:00010000:2.0:1788863747.384686:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e655c44380 00000100:00100000:2.0:1788863747.384730:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:2.0:1788863747.384740:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205561472:12345-192.168.204.35@tcp:3:cat.0 00000100:00100000:2.0:1788863747.384912:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2411:x1875759205561472:12345-192.168.204.35@tcp:3:cat.0 Request processed in 173us (460us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788863747.384920:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00002000:00100000:2.0:1788863747.384944:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff89e655c44380 x1875759205561472/t0(0) o3->7a6822fa-e36f-4316-b7e3-4bba6134cbda@192.168.204.35@tcp:733/0 lens 488/4536 e 0 to 0 dl 1788863758 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863747.384952:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e655c44380 with x1875759205561472 ext(0->4095) 00002000:00010000:2.0:1788863747.384955:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e655c44380 00010000:00010000:0.0:1788863748.267993:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863749.291473:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863750.123403:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863750.123431:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226580992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863750.123516:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863750.123563:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:3.0:1788863750.123600:0:8603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417247521966ns, next at 418247518741ns, rc = 0 00000100:00100000:1.0:1788863750.124106:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226581120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863750.124154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863750.124417:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226580992 00000100:00100000:2.0:1788863750.124426:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226580992 00000100:00100000:3.0:1788863750.124531:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226581120 00000100:00100000:3.0:1788863750.124536:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226581120 00000100:00100000:2.0:1788863750.124583:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788863750.124593:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226580992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863750.124621:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788863750.124690:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226580992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863750.124696:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788863750.124868:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863750.125304:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226580992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863750.125468:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788863750.125477:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226581120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863750.125490:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788863750.125540:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226581120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863750.125546:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788863750.126787:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226581120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863750.315293:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863750.638314:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863750.638357:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863750.638386:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863750.638412:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863750.638428:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863750.638445:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863750.638484:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863750.638522:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561856 00000100:00100000:1.0:1788863750.638531:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561856 00000100:00100000:3.0:1788863750.638593:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561600 00000100:00100000:1.0:1788863750.638594:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205562368 00000100:00100000:1.0:1788863750.638598:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205562368 00000100:00100000:3.0:1788863750.638602:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561600 00000100:00100000:1.0:1788863750.638619:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561728 00000100:00100000:1.0:1788863750.638624:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561728 00000100:00100000:3.0:1788863750.638658:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 396 00000100:00100000:1.0:1788863750.638658:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205562240 00000100:00100000:1.0:1788863750.638663:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205562240 00000100:00100000:3.0:1788863750.638673:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205561600:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863750.638685:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 362 00000100:00100000:1.0:1788863750.638694:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205561856:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863750.638759:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+13:2410:x1875759205561600:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 88us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863750.638766:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 396 00000100:00100000:3.0:1788863750.638801:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205562112 00000100:00100000:3.0:1788863750.638805:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205562112 00000100:00100000:3.0:1788863750.638831:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205561984 00000100:00100000:3.0:1788863750.638834:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205561984 00000100:00100000:3.0:1788863750.638856:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:3.0:1788863750.638863:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205562112:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863750.638980:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:2.0:1788863750.638990:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2410:x1875759205561984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863750.639397:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205561856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 702us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.639405:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 362 00000100:00100000:1.0:1788863750.639426:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 363 00000100:00100000:1.0:1788863750.639434:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205562368:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863750.639461:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205562368:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 30us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.639468:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 363 00000100:00100000:1.0:1788863750.639480:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 364 00000100:00100000:1.0:1788863750.639488:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:2410:x1875759205561728:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863750.639515:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+32:2410:x1875759205561728:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.639520:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 364 00000100:00100000:1.0:1788863750.639532:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 365 00000100:00100000:1.0:1788863750.639539:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205562240:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863750.639574:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2410:x1875759205562240:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 35us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.639580:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 365 00000100:00080000:0.0:1788863750.644896:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863750.644920:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863750.644924:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863750.644927:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863750.648415:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2410:x1875759205562112:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 9537us (10012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863750.648453:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:0.0:1788863750.649376:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226581248:0@lo:400:kworker.0 00000100:00100000:0.0:1788863750.649450:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863750.649574:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226581248 00000100:00100000:1.0:1788863750.649584:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226581248 00000100:00100000:1.0:1788863750.649634:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788863750.649654:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226581248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.650253:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3642:x1875759226581248:12345-0@lo:400:kworker.0 Request processed in 609us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.650263:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788863750.650341:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226581376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863750.650358:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226581248:0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.650376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863750.650405:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226581888:0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.650422:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226581376 00000100:00100000:3.0:1788863750.650426:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863750.650426:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226581376 00000100:00100000:3.0:1788863750.650443:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226582400:0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.650454:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226581888 00000100:00100000:1.0:1788863750.650457:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226581888 00000100:00100000:3.0:1788863750.650466:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863750.650486:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788863750.650492:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226581376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.650527:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226581376:12345-0@lo:400:kworker.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.650534:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788863750.650546:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788863750.650552:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226581888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.650579:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226581888:12345-0@lo:400:kworker.0 Request processed in 28us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.650585:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788863750.650701:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226581760:0@lo:400:kworker.0 00000100:00100000:0.0:1788863750.650731:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863750.650781:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226581376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863750.650787:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226582272:0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.650790:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226581888:0@lo:400:kworker.0 00000100:00100000:0.0:1788863750.650809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788863750.650836:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863750.650847:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582272 00000100:00100000:0.0:1788863750.650851:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582272 00000100:00100000:3.0:1788863750.650873:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226581504:0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.650899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863750.650980:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788863750.650991:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226582272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863750.651030:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226582272:12345-0@lo:400:kworker.0 Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863750.651036:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:0.0:1788863750.651051:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788863750.651069:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543bf0a80 x1875759226582272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863750.651097:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226582272:0@lo:400:kworker.0 00000100:00100000:2.0:1788863750.651140:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+8:2410:x1875759205561984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 12147us (12688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863750.651151:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:2.0:1788863750.651170:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582400 00000100:00100000:2.0:1788863750.651174:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582400 00000100:00100000:2.0:1788863750.651207:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788863750.651214:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226582400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863750.651252:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226582400:12345-0@lo:400:kworker.0 Request processed in 39us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863750.651258:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788863750.651741:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226582400:0@lo:400:kworker.0 00000100:00080000:2.0:1788863750.651768:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863750.652160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226581632:0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.652181:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226581760 00000100:00100000:1.0:1788863750.652187:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226581760 00000100:00100000:3.0:1788863750.652204:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226582016:0@lo:400:kworker.0 00000100:00100000:2.0:1788863750.652210:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863750.652234:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226581504 00000100:00100000:1.0:1788863750.652239:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226581504 00000100:00100000:2.0:1788863750.652240:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226582144:0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.652242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863750.652256:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788863750.652265:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226581760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.652266:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226582528:0@lo:400:kworker.0 00000100:00100000:2.0:1788863750.652275:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863750.652301:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863750.652317:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226581760:12345-0@lo:400:kworker.0 Request processed in 54us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.652323:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788863750.652332:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582528 00000100:00100000:3.0:1788863750.652335:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582528 00000100:00100000:1.0:1788863750.652337:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788863750.652342:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226581504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.652367:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788863750.652371:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226581504:12345-0@lo:400:kworker.0 Request processed in 29us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863750.652373:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226582528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.652377:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788863750.652398:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226581632 00000100:00100000:1.0:1788863750.652401:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226581632 00000100:00100000:3.0:1788863750.652416:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226582528:12345-0@lo:400:kworker.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863750.652421:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582016 00000100:00100000:3.0:1788863750.652422:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788863750.652424:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582016 00000100:00100000:1.0:1788863750.652435:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582144 00000100:00100000:1.0:1788863750.652438:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582144 00000100:00100000:1.0:1788863750.652450:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788863750.652455:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226581632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.652458:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226581504:0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.652487:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226581632:12345-0@lo:400:kworker.0 Request processed in 32us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863750.652489:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226582528:0@lo:400:kworker.0 00000100:00100000:1.0:1788863750.652494:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788863750.652505:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788863750.652510:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226582016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.652514:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788863750.652520:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226582144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863750.652546:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226582144:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863750.652552:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788863750.652625:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226582016:12345-0@lo:400:kworker.0 Request processed in 114us (384us total) trans 0 rc 0/0 00010000:00080000:3.0:1788863750.652631:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c2d80 x1875759226582016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863750.652640:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788863750.652642:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226582016:0@lo:400:kworker.0 00000100:00080000:3.0:1788863750.652668:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863750.652671:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863750.652673:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863750.652738:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226581632:0@lo:400:kworker.0 00000100:00100000:0.0:1788863750.652748:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226581760:0@lo:400:kworker.0 00000100:00100000:2.0:1788863750.652756:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226582144:0@lo:400:kworker.0 00000100:00100000:1.0:1788863751.155908:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226582784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863751.156069:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863751.156185:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582784 00000100:00100000:1.0:1788863751.156192:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582784 00000100:00100000:1.0:1788863751.156238:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788863751.156247:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226582784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863751.156279:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863751.156322:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226582784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863751.156330:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788863751.156377:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226582784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863751.156843:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863751.156857:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226582656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863751.156895:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863751.157733:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582656 00000100:00100000:1.0:1788863751.157742:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582656 00000100:00100000:1.0:1788863751.157794:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788863751.157803:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226582656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863751.157823:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863751.157884:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226582656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863751.157892:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788863751.158564:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226582656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788863751.340651:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863751.661363:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226582912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863751.661436:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863751.664223:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226582912 00000100:00100000:2.0:1788863751.664240:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226582912 00000100:00100000:2.0:1788863751.664297:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788863751.664308:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226582912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863751.664349:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863751.664439:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226582912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863751.664446:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000001:00080000:0.0:1788863751.664449:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1788863751.665217:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226582912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863751.665219:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226583040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863751.665296:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863751.665374:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583040 00000100:00100000:2.0:1788863751.665381:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583040 00000100:00100000:2.0:1788863751.665421:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788863751.665432:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226583040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863751.665460:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788863751.665525:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226583040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863751.665560:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000004:00080000:0.0:1788863751.665667:0:6516:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:1.0:1788863751.665689:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226583040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863751.667486:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226583168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788863751.667558:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863751.667660:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583168 00000100:00100000:2.0:1788863751.669560:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583168 00000001:00080000:0.0:1788863751.670314:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788863751.670344:0:6516:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e542906900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788863751.670349:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e542946900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e542906180 00000020:00080000:0.0:1788863751.670353:0:6516:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e542946c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e54483ec00 00000020:00080000:0.0:1788863751.670371:0:6516:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1788863751.670396:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863751.670417:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863751.670418:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00010000:00010000:0.0:1788863751.670426:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863751.670431:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537c00 already unused, calling callback (ffffffffc1a8b4f0) 00000100:00100000:2.0:1788863751.670435:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226583168:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788863751.670436:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863751.670444:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863751.670459:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff89e54382e700) 00010000:00010000:0.0:1788863751.670462:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863751.670466:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863751.670471:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641537c00/0xf569beb9d4b69d45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10368 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863751.670582:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788863751.670586:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788863744 -> 1788863744 00002000:00010000:2.0:1788863751.670588:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1788863744 -> 1788863744 00002000:00010000:2.0:1788863751.670590:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788863744 -> 1788863744 00002000:00010000:2.0:1788863751.670592:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788863751.670680:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1875759226583168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 251us (3121us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788863751.670691:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00080000:1.0:1788863751.671027:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788863751.671073:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000004:00080000:1.0:1788863751.671127:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e543611880/2, rc 0, transno 4294967325 00000100:00100000:1.0:1788863751.671134:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226583168:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1788863751.671784:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788863751.671794:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:2.0:1788863752.363394:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863752.964191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863752.965121:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205562496 00000100:00100000:3.0:1788863752.965137:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205562496 00000100:00100000:3.0:1788863752.965237:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 254 00000100:00100000:3.0:1788863752.965251:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:12150:x1875759205562496:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788863752.965401:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:12150:x1875759205562496:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 Request processed in 153us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863752.965411:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 254 00000100:00080000:2.0:1788863752.965712:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863752.972640:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863752.973504:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205562624 00000100:00100000:3.0:1788863752.973529:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205562624 00000100:00080000:2.0:1788863752.973593:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863752.973832:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 255 00000100:00100000:3.0:1788863752.973848:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:12150:x1875759205562624:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788863752.974000:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:12150:x1875759205562624:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 Request processed in 157us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863752.974040:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 255 00000100:00100000:2.0:1788863752.977857:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863752.979803:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205562880 00000100:00100000:3.0:1788863752.979825:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205562880 00000100:00100000:3.0:1788863752.979921:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:3.0:1788863752.979933:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:12150:x1875759205562880:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788863752.980391:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:12150:x1875759205562880:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 459us (2553us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788863752.980400:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00010000:00010000:0.0:1788863753.388827:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863754.155942:0:13815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863754.155958:0:13815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863754.156657:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788863754.156672:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788863754.351639:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863754.412709:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863754.908248:0:14875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:35:53 (1788863753) 00000100:00100000:1.0:1788863755.244291:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863755.244323:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226583296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863755.244414:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863755.244496:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583296 00000100:00100000:1.0:1788863755.244507:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583296 00000100:00100000:1.0:1788863755.244586:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788863755.244597:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226583296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863755.244637:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788863755.244689:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226583296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.244697:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788863755.244722:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863755.244754:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788863755.244761:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788863755.244786:0:3643:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89e543611880 x1875759226583168/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788863767 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863755.244805:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226583296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863755.245049:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226583424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863755.245116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863755.245184:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583424 00000100:00100000:2.0:1788863755.245190:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583424 00000100:00100000:2.0:1788863755.245225:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788863755.245231:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226583424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863755.245242:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788863755.245271:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226583424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.245277:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788863755.245320:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863755.245343:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226583424:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863755.437166:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863755.763052:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863755.766310:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563008 00000100:00100000:3.0:1788863755.766330:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563008 00000100:00100000:3.0:1788863755.766502:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 398 00000100:00100000:3.0:1788863755.766516:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205563008:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863755.767037:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed3e4520-177d-4764-9911-f67f7853934a+13:2408:x1875759205563008:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 523us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863755.767049:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 398 00000100:00100000:1.0:1788863755.770046:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863755.770131:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863755.770167:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863755.770191:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863755.770214:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863755.770244:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863755.770303:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563136 00000100:00100000:1.0:1788863755.770316:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563136 00000100:00100000:1.0:1788863755.770391:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563264 00000100:00100000:1.0:1788863755.770394:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563264 00000100:00100000:1.0:1788863755.770415:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563776 00000100:00100000:1.0:1788863755.770418:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563776 00000100:00100000:1.0:1788863755.771571:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563648 00000100:00100000:1.0:1788863755.771798:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563648 00000100:00100000:1.0:1788863755.771860:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 372 00000100:00100000:1.0:1788863755.771872:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:2408:x1875759205563136:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863755.772577:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:2408:x1875759205563136:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 703us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.772669:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 372 00000100:00100000:1.0:1788863755.772704:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 373 00000100:00100000:1.0:1788863755.772715:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205563264:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863755.772768:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205563264:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 56us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.772845:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 374 00000100:00100000:0.0:1788863755.772858:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205563776:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863755.772914:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205563776:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 60us (2721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.774358:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 373 00000100:00100000:0.0:1788863755.774375:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 374 00000100:00100000:2.0:1788863755.774514:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 375 00000100:00100000:2.0:1788863755.774535:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205563648:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863755.774629:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205563648:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 104us (4383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.774637:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 375 00000100:00100000:1.0:1788863755.774680:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563520 00000100:00100000:1.0:1788863755.774692:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563520 00000100:00100000:1.0:1788863755.774811:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563392 00000100:00100000:1.0:1788863755.774816:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563392 00000100:00100000:0.0:1788863755.774859:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:0.0:1788863755.774869:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205563520:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863755.774918:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2408:x1875759205563520:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (4750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.774925:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:0.0:1788863755.774940:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:0.0:1788863755.774947:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205563392:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863755.774983:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2408:x1875759205563392:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 36us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.774989:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:0.0:1788863755.775187:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226583552:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.775450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.775569:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863755.775577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226583680:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.775613:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.775643:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583680 00000100:00100000:0.0:1788863755.775648:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583680 00000100:00100000:0.0:1788863755.775681:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788863755.775689:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226583680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.775731:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226583680:12345-0@lo:400:kworker.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.775749:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788863755.775874:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226583680:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.775927:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226583808:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.775963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.775996:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583808 00000100:00100000:0.0:1788863755.775999:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583808 00000100:00100000:0.0:1788863755.776023:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788863755.776029:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226583808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.776063:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226583808:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.776100:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788863755.776132:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226583808:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.776161:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863755.776167:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226583936:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.776192:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.776619:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226584064:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.776651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.776683:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584064 00000100:00100000:0.0:1788863755.776687:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584064 00000100:00100000:0.0:1788863755.776710:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788863755.776716:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226584064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.776749:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226584064:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.776756:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788863755.776872:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226584064:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.776901:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863755.776909:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226584192:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.776934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.776959:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583936 00000100:00100000:0.0:1788863755.776963:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583936 00000100:00100000:0.0:1788863755.776983:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584192 00000100:00100000:0.0:1788863755.776986:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584192 00000100:00100000:0.0:1788863755.777004:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788863755.777010:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226583936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.777044:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226583936:12345-0@lo:400:kworker.0 Request processed in 33us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.777049:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788863755.777061:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788863755.777066:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226584192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.777183:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226584192:12345-0@lo:400:kworker.0 Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.777189:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788863755.777699:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226583936:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.777731:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226584192:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.777861:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226584320:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.777897:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.777929:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584320 00000100:00100000:0.0:1788863755.777935:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584320 00000100:00100000:0.0:1788863755.777968:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788863755.777974:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226584320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778020:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226584320:12345-0@lo:400:kworker.0 Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.778027:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00080000:0.0:1788863755.778056:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e655c44700 x1875759226584320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863755.778067:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226584320:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778199:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863755.778205:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226584448:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778303:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.778332:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584448 00000100:00100000:0.0:1788863755.778336:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584448 00000100:00100000:0.0:1788863755.778365:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788863755.778372:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226584448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778410:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226584448:12345-0@lo:400:kworker.0 Request processed in 38us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.778415:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788863755.778441:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226584448:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778480:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226584576:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778503:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.778527:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584576 00000100:00100000:0.0:1788863755.778531:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584576 00000100:00100000:0.0:1788863755.778569:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788863755.778575:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226584576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778609:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226584576:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.778628:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00080000:0.0:1788863755.778653:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67f807800 x1875759226584576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863755.778663:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226584576:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778695:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863755.778702:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226584704:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778729:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.778759:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584704 00000100:00100000:0.0:1788863755.778762:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584704 00000100:00100000:0.0:1788863755.778885:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863755.778893:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226584704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.778932:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226584704:12345-0@lo:400:kworker.0 Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.778938:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863755.778967:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226584704:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.779002:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226584832:0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.779027:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.779056:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584832 00000100:00100000:0.0:1788863755.779059:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584832 00000100:00100000:0.0:1788863755.779119:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788863755.779127:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226584832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.779232:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226584832:12345-0@lo:400:kworker.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.779239:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788863755.779312:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863755.779328:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863755.779331:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863755.779334:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863755.779534:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226583552 00000100:00100000:0.0:1788863755.779540:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226583552 00000100:00100000:0.0:1788863755.779583:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788863755.779591:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226583552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863755.779634:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226583552:12345-0@lo:400:kworker.0 Request processed in 45us (4186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.779641:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788863755.779682:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e655c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226583552:0@lo:400:kworker.0 00000100:00100000:2.0:1788863755.782692:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788863755.782708:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e543612680, transno 4294967311 00000100:00100000:2.0:1788863755.782736:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226584832:0@lo:400:kworker.0 00000100:00100000:2.0:1788863756.268530:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863756.268576:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226584960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863756.268670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863756.268764:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226584960 00000100:00100000:2.0:1788863756.268802:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226584960 00000100:00100000:2.0:1788863756.268870:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788863756.268883:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226584960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863756.268926:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863756.268981:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226584960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863756.268988:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788863756.269042:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226584960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863756.271667:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226585088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863756.271791:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863756.271999:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585088 00000100:00100000:2.0:1788863756.272013:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585088 00000100:00100000:2.0:1788863756.272127:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788863756.272138:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226585088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863756.272182:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788863756.272255:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226585088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863756.272262:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788863756.272724:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226585088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788863756.459698:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863756.781049:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863756.781107:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226585216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863756.781217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863756.781752:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585216 00000100:00100000:1.0:1788863756.781765:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585216 00000100:00100000:1.0:1788863756.781830:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788863756.781839:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226585216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863756.781887:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788863756.781965:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226585216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863756.781973:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788863756.782121:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863756.782135:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226585344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863756.782174:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863756.782218:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585344 00000100:00100000:0.0:1788863756.782222:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585344 00000100:00100000:0.0:1788863756.782250:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788863756.782257:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226585344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863756.782279:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788863756.782341:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226585344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.782348:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788863756.782409:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226585344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863756.782450:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226585216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863757.407488:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863757.410455:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205563904 00000100:00100000:0.0:1788863757.410477:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205563904 00000100:00100000:0.0:1788863757.411263:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 256 00000100:00100000:0.0:1788863757.411283:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:13161:x1875759205563904:12345-192.168.204.35@tcp:101:lsof.0 00010000:00010000:0.0:1788863757.411326:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863757.411366:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69dd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518825b expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863757.411461:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69dd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863757.411479:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863757.411497:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863757.411576:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788863757.411581:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863757.411638:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863757.411672:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b69dd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518825b expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863757.411723:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518825b expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863757.411733:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:0.0:1788863757.411737:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863757.411741:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863757.411842:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:13161:x1875759205563904:12345-192.168.204.35@tcp:101:lsof.0 Request processed in 566us (4371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863757.411851:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 256 00000100:00080000:1.0:1788863757.414098:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788863757.495647:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788863757.806680:0:8444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788863757.806775:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788863757.806786:0:6516:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788863757.806857:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788863757.806874:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788863758.510036:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863759.414399:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863759.415506:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205564160 00000100:00100000:2.0:1788863759.415525:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205564160 00000100:00100000:2.0:1788863759.415633:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:2.0:1788863759.415648:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+18:13162:x1875759205564160:12345-192.168.204.35@tcp:35:umount.0 00000100:00100000:2.0:1788863759.416014:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:13162:x1875759205564160:12345-192.168.204.35@tcp:35:umount.0 Request processed in 370us (1631us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788863759.416022:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00080000:1.0:1788863759.416479:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863759.419978:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863759.420380:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205564416 00000100:00100000:2.0:1788863759.420395:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205564416 00000100:00100000:2.0:1788863759.420481:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:2.0:1788863759.420495:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:13162:x1875759205564416:12345-192.168.204.35@tcp:35:umount.0 00000100:00100000:2.0:1788863759.421032:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:13162:x1875759205564416:12345-192.168.204.35@tcp:35:umount.0 Request processed in 538us (1067us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788863759.421043:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:3.0:1788863759.425647:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863759.427948:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205564672 00000100:00100000:0.0:1788863759.427969:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205564672 00000100:00100000:0.0:1788863759.428213:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788863759.428226:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66c694050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+20:13162:x1875759205564672:12345-192.168.204.35@tcp:35:umount.0 00000100:00100000:0.0:1788863759.428637:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66c694050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:13162:x1875759205564672:12345-192.168.204.35@tcp:35:umount.0 Request processed in 412us (3004us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788863759.428647:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:3.0:1788863759.433036:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863759.433338:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205564928 00000100:00100000:2.0:1788863759.433352:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205564928 00000100:00100000:2.0:1788863759.433444:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:2.0:1788863759.433456:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+21:13162:x1875759205564928:12345-192.168.204.35@tcp:35:umount.0 00000100:00100000:2.0:1788863759.433855:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:13162:x1875759205564928:12345-192.168.204.35@tcp:35:umount.0 Request processed in 400us (834us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788863759.433864:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:1.0:1788863759.438453:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863759.438596:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205565056 00000100:00100000:2.0:1788863759.438610:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205565056 00000100:00100000:2.0:1788863759.438699:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1788863759.438712:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed3e4520-177d-4764-9911-f67f7853934a+13:2409:x1875759205565056:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863759.438733:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863759.438758:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99000/0xf569beb9d4b68dbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187db5 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.438777:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863759.438858:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed3e4520-177d-4764-9911-f67f7853934a+12:2409:x1875759205565056:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 149us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863759.438867:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:3.0:1788863759.444818:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863759.444935:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205565184 00000100:00100000:2.0:1788863759.444949:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205565184 00000100:00100000:2.0:1788863759.445033:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1788863759.445046:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ed3e4520-177d-4764-9911-f67f7853934a+12:2408:x1875759205565184:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863759.445103:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863759.445129:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d200/0xf569beb9d4b68d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187d76 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.445151:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863759.445235:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ed3e4520-177d-4764-9911-f67f7853934a+11:2408:x1875759205565184:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 190us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863759.445244:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:3.0:1788863759.446684:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863759.446793:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205565312 00000100:00100000:0.0:1788863759.446804:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205565312 00000100:00100000:0.0:1788863759.446872:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:0.0:1788863759.446886:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed3e4520-177d-4764-9911-f67f7853934a+11:2408:x1875759205565312:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863759.446915:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863759.446935:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d91e00/0xf569beb9d4b69010 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e8e expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.446974:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863759.447042:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed3e4520-177d-4764-9911-f67f7853934a+10:2408:x1875759205565312:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 158us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863759.447051:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:3.0:1788863759.452944:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863759.453053:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205565440 00000100:00100000:2.0:1788863759.453109:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205565440 00000100:00100000:2.0:1788863759.453185:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:2.0:1788863759.453199:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2407:x1875759205565440:12345-192.168.204.35@tcp:9:umount.0 00000020:00000080:2.0:1788863759.453261:0:14490:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b690db 00000100:00080000:2.0:1788863759.453272:0:14490:0:(import.c:65:import_set_state_nolock()) ffff89e675667000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863759.453343:0:14490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788863759.453566:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+2:2407:x1875759205565440:12345-192.168.204.35@tcp:9:umount.0 Request processed in 370us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863759.453575:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00080000:1.0:1788863759.453765:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788863759.454044:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863759.461233:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863759.461354:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205565824 00000100:00100000:0.0:1788863759.461391:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205565824 00000100:00080000:1.0:1788863759.461489:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863759.461491:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:0.0:1788863759.461503:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+7:2407:x1875759205565824:12345-192.168.204.35@tcp:9:umount.0 00000020:00000080:0.0:1788863759.461545:0:8451:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69351 00000020:00010000:0.0:1788863759.461554:0:8451:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e67f895000: total 0 00000100:00080000:0.0:1788863759.461560:0:8451:0:(import.c:65:import_set_state_nolock()) ffff89e67f897800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863759.461633:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:2.0:1788863759.461670:0:6526:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e67f895000: total 0 00010000:00010000:2.0:1788863759.461725:0:6526:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e67f895000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788863759.461793:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61d1f6e/0xf569beb9d4b69dca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188254 expref: 5 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.461832:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f35383/0xf569beb9d4b69709 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188078 expref: 4 pid: 8606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863759.461842:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+3:2407:x1875759205565824:12345-192.168.204.35@tcp:9:umount.0 Request processed in 342us (626us total) trans 0 rc 0/0 00010000:00010000:2.0:1788863759.461849:0:6526:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e67f895000, canceled 2 locks, left on hash table 0. 00000100:00100000:0.0:1788863759.461850:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 82 00010000:00010000:2.0:1788863759.461861:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863759.461864:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863759.461866:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863759.470437:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863759.470532:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205566848 00000100:00100000:0.0:1788863759.470547:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205566848 00000100:00100000:0.0:1788863759.470626:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 257 00000100:00100000:0.0:1788863759.470638:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+22:2407:x1875759205566848:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:0.0:1788863759.470696:0:6537:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68d15 00000020:00010000:0.0:1788863759.470718:0:6537:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e543424800: total 0 00000100:00080000:0.0:1788863759.470724:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e67aeec800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863759.470761:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1788863759.470790:0:6525:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e543424800: total 0 00010000:00010000:2.0:1788863759.470856:0:6525:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e543424800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788863759.470903:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788863759.470906:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788863759.470916:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90800/0xf569beb9d4b696f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188071 expref: 21 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.470941:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863759.470943:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788863759.470955:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b69a6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518816d expref: 20 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.470973:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788863759.470975:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1788863759.470975:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a6822fa-e36f-4316-b7e3-4bba6134cbda+19:2407:x1875759205566848:12345-192.168.204.35@tcp:39:umount.0 Request processed in 339us (553us total) trans 4294967527 rc 0/0 00010000:00010000:2.0:1788863759.470979:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d90e00/0xf569beb9d4b693ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187f91 expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863759.470989:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 257 00010000:00010000:2.0:1788863759.471007:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863759.471009:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863759.471013:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536000/0xf569beb9d4b69d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518823f expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471027:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e543755400) 00010000:00010000:2.0:1788863759.471029:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863759.471033:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98c00/0xf569beb9d4b69056 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187ea3 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471052:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863759.471055:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788863759.471058:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641536600/0xf569beb9d4b69db5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518824d expref: 15 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471111:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788863759.471115:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863759.471118:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e641378a00/0xf569beb9d4b695ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518802b expref: 14 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471132:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:2.0:1788863759.471140:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863759.471146:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b69764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518808d expref: 13 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471163:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff89e643aa2300) 00010000:00010000:2.0:1788863759.471166:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863759.471170:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b69cab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188207 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471187:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788863759.471190:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788863759.471193:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030000/0xf569beb9d4b690b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187eb8 expref: 11 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471211:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e643aa2500) 00010000:00010000:2.0:1788863759.471213:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863759.471217:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f600/0xf569beb9d4b6903a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e9c expref: 10 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471233:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff89e643aa2d00) 00010000:00010000:2.0:1788863759.471235:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788863759.471239:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b69780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188094 expref: 9 pid: 12972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471252:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788863759.471254:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863759.471258:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b696ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188063 expref: 8 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863759.471284:0:6525:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e543424800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788863759.471299:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863759.471301:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863759.471303:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863759.483977:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863759.485208:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205566976 00000100:00100000:0.0:1788863759.485225:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205566976 00000100:00100000:1.0:1788863759.485562:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 258 00000100:00100000:1.0:1788863759.485576:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+5:2407:x1875759205566976:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:1.0:1788863759.485618:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68d0e 00000100:00080000:1.0:1788863759.485640:0:12972:0:(import.c:65:import_set_state_nolock()) ffff89e5439c0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788863759.485691:0:12972:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788863759.485884:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a6822fa-e36f-4316-b7e3-4bba6134cbda+3:2407:x1875759205566976:12345-192.168.204.35@tcp:39:umount.0 Request processed in 312us (1923us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788863759.485904:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 258 00010000:00010000:3.0:1788863759.485966:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863759.486737:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788863759.535538:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863760.366726:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863760.366757:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226585472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863760.366859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863760.368237:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585472 00000100:00100000:1.0:1788863760.368256:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585472 00000100:00100000:1.0:1788863760.368365:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788863760.368379:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226585472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863760.368463:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788863760.368561:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226585472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863760.368582:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1788863760.368682:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863760.368729:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788863760.368737:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e543611880, transno 4294967325 00000100:00100000:3.0:1788863760.368765:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226585472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863760.370692:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863760.370722:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226585600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863760.370811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863760.372549:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585600 00000100:00100000:1.0:1788863760.372581:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585600 00000100:00100000:1.0:1788863760.372745:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788863760.372758:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226585600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863760.372794:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788863760.372890:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226585600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (2077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863760.372910:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788863760.373311:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863760.373370:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226585600:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863760.557662:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863760.875864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863760.875983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863760.876015:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863760.876047:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205567360 00000100:00100000:2.0:1788863760.876059:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205567360 00000100:00100000:2.0:1788863760.876225:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205567232 00000100:00100000:2.0:1788863760.876230:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205567232 00000100:00100000:3.0:1788863760.876295:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 382 00000100:00100000:3.0:1788863760.876320:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205567360:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863760.876429:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2408:x1875759205567360:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 113us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863760.876438:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 382 00000100:00100000:3.0:1788863760.876495:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226585856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.876551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863760.877570:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226586368:0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.877635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863760.877721:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863760.877728:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863760.877890:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585856 00000100:00100000:1.0:1788863760.877898:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585856 00000100:00100000:1.0:1788863760.877948:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226586368 00000100:00100000:1.0:1788863760.877951:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226586368 00000100:00080000:1.0:1788863760.877969:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863760.877989:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788863760.878019:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226585856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863760.878073:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226585856:12345-0@lo:400:kworker.0 Request processed in 56us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863760.878099:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788863760.878118:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788863760.878125:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226586368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863760.878152:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226586368:12345-0@lo:400:kworker.0 Request processed in 28us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863760.878158:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788863760.878199:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226586112:0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.878770:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 385 00000100:00100000:2.0:1788863760.878781:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2408:x1875759205567232:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863760.878846:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2408:x1875759205567232:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 67us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863760.878853:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 385 00000100:00100000:2.0:1788863760.879068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226585984:0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.879129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863760.879191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863760.879586:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205567104 00000100:00100000:0.0:1788863760.879596:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205567104 00000100:00100000:0.0:1788863760.879716:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 400 00000100:00100000:0.0:1788863760.879725:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:2408:x1875759205567104:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863760.879951:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed3e4520-177d-4764-9911-f67f7853934a+10:2408:x1875759205567104:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 226us (4105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863760.879959:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 400 00000100:00100000:0.0:1788863760.880004:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585984 00000100:00100000:0.0:1788863760.880008:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585984 00000100:00100000:0.0:1788863760.880034:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788863760.880041:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226585984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863760.880106:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226585984:12345-0@lo:400:kworker.0 Request processed in 65us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863760.880113:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788863760.880624:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226585728:0@lo:400:kworker.0 00000100:00100000:0.0:1788863760.880667:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863760.884252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226586368:0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.884280:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226586880:0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.884407:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863760.884507:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226585856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.886249:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226586880 00000100:00100000:3.0:1788863760.886265:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226586880 00000100:00100000:3.0:1788863760.886356:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788863760.886368:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226586880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.886485:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226586880:12345-0@lo:400:kworker.0 Request processed in 119us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863760.886494:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788863760.886528:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226586112 00000100:00100000:3.0:1788863760.886532:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226586112 00000100:00100000:3.0:1788863760.886561:0:10368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788863760.886568:0:10368:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226586112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.886616:0:10368:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226586112:12345-0@lo:400:kworker.0 Request processed in 49us (8386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863760.886622:0:10368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:3.0:1788863760.886641:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863760.886679:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226586880:0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.886732:0:6532:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226585728 00000100:00100000:3.0:1788863760.886737:0:6532:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226585728 00000100:00100000:3.0:1788863760.886784:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788863760.886792:0:6532:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226585728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.886830:0:6532:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226585728:12345-0@lo:400:kworker.0 Request processed in 40us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863760.886837:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788863760.887207:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226585984:0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.887226:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226586496:0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.887278:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863760.887327:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226587008:0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.887355:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863760.887401:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226586496 00000100:00100000:3.0:1788863760.887414:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226586496 00000100:00100000:2.0:1788863760.887438:0:8606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587008 00000100:00100000:2.0:1788863760.887455:0:8606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587008 00000100:00100000:3.0:1788863760.887489:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788863760.887502:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226586496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.887502:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788863760.887516:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226587008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.888584:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226587008:12345-0@lo:400:kworker.0 Request processed in 1066us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863760.888597:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:2.0:1788863760.888684:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4b8000 x1875759226586496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863760.888701:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226586496:0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.888715:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226587008:0@lo:400:kworker.0 00000100:00080000:2.0:1788863760.888762:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863760.888929:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863760.891852:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226586112:0@lo:400:kworker.0 00000100:00100000:1.0:1788863760.891877:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226586624:0@lo:400:kworker.0 00000100:00100000:1.0:1788863760.891976:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863760.892559:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226586624 00000100:00100000:2.0:1788863760.892570:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226586624 00000100:00100000:2.0:1788863760.892682:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788863760.892694:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226586624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.892796:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226586624:12345-0@lo:400:kworker.0 Request processed in 103us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863760.892805:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:1.0:1788863760.893123:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863760.893165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226586624:0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.893455:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226586496:12345-0@lo:400:kworker.0 Request processed in 5942us (6162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863760.893465:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788863760.894840:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226585728:0@lo:400:kworker.0 00000100:00100000:0.0:1788863760.894862:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226586240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863760.894949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863760.894993:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226586752:0@lo:400:kworker.0 00000100:00100000:0.0:1788863760.895037:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863760.895266:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226586752 00000100:00100000:2.0:1788863760.895275:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226586752 00000100:00100000:2.0:1788863760.895385:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788863760.895396:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226586752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863760.895476:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226586752:12345-0@lo:400:kworker.0 Request processed in 83us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863760.895511:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788863760.895792:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226586240 00000100:00100000:3.0:1788863760.895798:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226586240 00000100:00100000:3.0:1788863760.895844:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788863760.895854:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226586240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863760.895902:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226586240:12345-0@lo:400:kworker.0 Request processed in 50us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863760.895910:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788863760.896128:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226586240:0@lo:400:kworker.0 00010000:00080000:0.0:1788863760.896163:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4ba300 x1875759226586752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863760.896176:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226586752:0@lo:400:kworker.0 00000100:00080000:1.0:1788863760.896837:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863761.387618:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863761.388106:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226587264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863761.388324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863761.388511:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863761.388540:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863761.388809:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587264 00000100:00100000:1.0:1788863761.388819:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587264 00000100:00100000:1.0:1788863761.388867:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587136 00000100:00100000:1.0:1788863761.388869:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587136 00000100:00100000:1.0:1788863761.388887:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788863761.388911:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226587264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863761.388951:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863761.389039:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226587264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863761.389068:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788863761.389117:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788863761.389123:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226587136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863761.389135:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863761.389173:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226587136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863761.389179:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788863761.389505:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226587264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863761.389525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226587136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788863761.579535:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863761.846407:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863761.846473:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863761.846569:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863761.846743:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205567744 00000100:00100000:2.0:1788863761.846757:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205567744 00000100:00100000:2.0:1788863761.846834:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205567488 00000100:00100000:2.0:1788863761.846837:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205567488 00000100:00100000:2.0:1788863761.846855:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205567616 00000100:00100000:2.0:1788863761.846859:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205567616 00000100:00100000:2.0:1788863761.846877:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:2.0:1788863761.846888:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed3e4520-177d-4764-9911-f67f7853934a+12:2410:x1875759205567744:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863761.846909:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863761.846944:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d90a00/0xf569beb9d4b69009 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187e87 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863761.846969:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863761.847046:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed3e4520-177d-4764-9911-f67f7853934a+11:2410:x1875759205567744:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 158us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863761.847055:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:2.0:1788863761.847141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788863761.847148:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed3e4520-177d-4764-9911-f67f7853934a+10:2409:x1875759205567488:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863761.847156:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863761.847165:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115800/0xf569beb9d4b68e11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dca expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863761.847176:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863761.847192:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed3e4520-177d-4764-9911-f67f7853934a+9:2409:x1875759205567488:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 45us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863761.847198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788863761.847228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:2.0:1788863761.847233:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed3e4520-177d-4764-9911-f67f7853934a+8:2409:x1875759205567616:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863761.847240:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863761.847249:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d91400/0xf569beb9d4b68e18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dfb expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863761.847257:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863761.847275:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed3e4520-177d-4764-9911-f67f7853934a+7:2409:x1875759205567616:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 42us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863761.847292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:0.0:1788863761.864649:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863761.864947:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205568000 00000100:00100000:2.0:1788863761.864960:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205568000 00000100:00100000:2.0:1788863761.865038:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 259 00000100:00100000:2.0:1788863761.865050:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+6:2407:x1875759205568000:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:2.0:1788863761.865142:0:6537:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68e26 00000020:00010000:2.0:1788863761.865152:0:6537:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e543a46000: total 0 00000100:00080000:2.0:1788863761.865158:0:6537:0:(import.c:65:import_set_state_nolock()) ffff89e543a47800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863761.865206:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788863761.865433:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2407:x1875759205568000:12345-192.168.204.35@tcp:39:umount.0 Request processed in 374us (787us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788863761.865443:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 259 00000020:00010000:1.0:1788863761.865573:0:6526:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e543a46000: total 0 00010000:00010000:1.0:1788863761.865578:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863761.865659:0:6526:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e543a46000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788863761.865932:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2400) 00010000:00010000:1.0:1788863761.865937:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863761.865948:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b69dd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518825b expref: 4 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.865975:0:6526:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e543a46000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788863761.865989:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863761.865991:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863761.865993:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863761.881859:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863761.882123:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205568128 00000100:00100000:3.0:1788863761.882136:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205568128 00000100:00100000:3.0:1788863761.882211:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 260 00000100:00100000:3.0:1788863761.882223:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+5:2407:x1875759205568128:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:3.0:1788863761.882278:0:6536:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68e2d 00000100:00080000:3.0:1788863761.882291:0:6536:0:(import.c:65:import_set_state_nolock()) ffff89e543a46800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863761.882346:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788863761.882646:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37081b3d-46f9-4ae6-9395-ddf0b5561d0d+3:2407:x1875759205568128:12345-192.168.204.35@tcp:39:umount.0 Request processed in 424us (803us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788863761.882655:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 260 00010000:00010000:0.0:1788863761.882778:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863761.899451:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226587392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863761.899557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863761.899729:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587392 00000100:00100000:0.0:1788863761.899739:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587392 00000100:00100000:0.0:1788863761.899806:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788863761.899827:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226587392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863761.899873:0:9795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788863761.899946:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226587392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863761.899953:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788863761.900291:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226587392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863761.900543:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863761.900575:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226587520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863761.900620:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863761.900714:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587520 00000100:00100000:2.0:1788863761.900720:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587520 00000100:00100000:2.0:1788863761.900763:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788863761.900772:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226587520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863761.900799:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788863761.900865:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226587520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863761.900872:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788863761.901067:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226587520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863761.973000:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863761.973134:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205568384 00000100:00100000:0.0:1788863761.973158:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205568384 00000100:00100000:0.0:1788863761.973236:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 402 00000100:00100000:0.0:1788863761.973248:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+7:2407:x1875759205568384:12345-192.168.204.35@tcp:251:umount.0 00000020:00000080:0.0:1788863761.973338:0:6530:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68ceb 00000020:00010000:0.0:1788863761.973347:0:6530:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e543439800: total 0 00000100:00080000:0.0:1788863761.973353:0:6530:0:(import.c:65:import_set_state_nolock()) ffff89e54343b000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788863761.973475:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed3e4520-177d-4764-9911-f67f7853934a+3:2407:x1875759205568384:12345-192.168.204.35@tcp:251:umount.0 Request processed in 229us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863761.973484:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 402 00000020:00010000:1.0:1788863761.974359:0:9549:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e543439800: total 0 00010000:00010000:1.0:1788863761.974453:0:9549:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e543439800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788863761.974514:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d90c00/0xf569beb9d4b68dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25187dbc expref: 2 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.974535:0:9549:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e543439800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788863761.974547:0:9549:0:(genops.c:885:class_export_put()) final put ffff89e543439800/ed3e4520-177d-4764-9911-f67f7853934a 00010000:00010000:1.0:1788863761.974565:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863761.974568:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863761.974570:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788863761.978001:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543439800/ed3e4520-177d-4764-9911-f67f7853934a for MGS 00000020:00000080:3.0:1788863761.980047:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e54343b000 for MGS 00010000:00010000:1.0:1788863762.603677:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863763.630724:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788863764.329028:0:15071:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788863764.345252:0:15071:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788863764.345357:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863764.345392:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863764.345401:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863764.345409:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863764.345443:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788863764.345451:0:15071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788863764.345486:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863764.345492:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788863764.345500:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788863764.345535:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788863764.345588:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226587648:0@lo:39:umount.0 00000100:00100000:2.0:1788863764.345679:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863764.345784:0:12972:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587648 00010000:00010000:3.0:1788863764.345984:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863764.345994:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.346003:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863764.346009:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.346020:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863764.346028:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863764.346034:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863764.346036:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788863764.346039:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788863764.346071:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.346100:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863764.346122:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.346129:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d90600/0xf569beb9d4b68d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.346164:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.346166:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.346169:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863764.346183:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226587776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863764.346231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863764.346296:0:6523:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587776 00000100:00100000:3.0:1788863764.346300:0:6523:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587776 00000100:00100000:3.0:1788863764.346363:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788863764.346384:0:6523:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e448850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3640:x1875759226587776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863764.346402:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863764.346422:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114200/0xf569beb9d4b68d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68d93 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.346439:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863764.346478:0:6523:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e448850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:3640:x1875759226587776:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863764.346486:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788863764.346577:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226587776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863764.346946:0:12972:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587648 00000100:00100000:3.0:1788863764.347057:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788863764.347065:0:12972:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875759226587648:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788863764.347131:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68902 00000100:00080000:3.0:1788863764.347143:0:12972:0:(import.c:65:import_set_state_nolock()) ffff89e676318000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788863764.347222:0:12972:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1875759226587648:12345-0@lo:39:umount.0 Request processed in 158us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863764.347230:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:3.0:1788863764.347249:0:12972:0:(genops.c:885:class_export_put()) final put ffff89e67631f800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788863764.347394:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788863764.347408:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67631f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788863764.347515:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e676318000 for lustre-MDT0000 00000100:00080000:2.0:1788863764.347631:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788863764.347649:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226587648:0@lo:39:umount.0 00000100:00080000:3.0:1788863764.348389:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863764.348396:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788863764.348403:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788863764.354417:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354446:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354453:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354460:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354496:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863764.354504:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354511:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354517:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354524:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354570:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788863764.354590:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863764.354597:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354605:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863764.354610:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354621:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863764.354629:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863764.354635:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863764.354638:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788863764.354687:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354694:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863764.354723:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354730:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d99200/0xf569beb9d4b68da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68da8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354745:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863764.354748:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354762:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863764.354765:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.354771:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863764.354776:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863764.354780:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863764.354782:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788863764.354785:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788863764.355385:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.356967:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.356987:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863764.357025:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.357032:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b68ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68cac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.357050:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.357052:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.357055:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863764.357928:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226587904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863764.358034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863764.358495:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226588032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863764.358549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863764.358949:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226587904 00000100:00100000:2.0:1788863764.358961:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226587904 00000100:00100000:2.0:1788863764.359034:0:10356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588032 00000100:00100000:2.0:1788863764.359037:0:10356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588032 00000100:00100000:2.0:1788863764.359068:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788863764.359345:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+24:3641:x1875759226587904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863764.359366:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863764.359403:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d90400/0xf569beb9d4b68da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68da1 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863764.359426:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863764.359485:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+23:3641:x1875759226587904:12345-0@lo:103:ldlm_bl.0 Request processed in 407us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863764.359493:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788863764.359518:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788863764.359525:0:10356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+22:3642:x1875759226588032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863764.359534:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863764.359543:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167c400/0xf569beb9d4b68cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68ca5 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863764.359554:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863764.359576:0:10356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3642:x1875759226588032:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863764.359583:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788863764.359645:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3641:1875759226587904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863764.361445:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3642:1875759226588032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863764.363670:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.363697:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.363704:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.363711:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.363737:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863764.363756:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863764.363763:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.363772:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863764.363777:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.363787:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863764.365588:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863764.365642:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788863764.365646:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788863764.365650:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788863764.365717:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.365725:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863764.365767:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.365776:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d91000/0xf569beb9d4b68ffb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69002 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863764.365951:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226588160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863764.367068:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863764.367355:0:10355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588160 00000100:00100000:0.0:1788863764.367367:0:10355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588160 00000100:00100000:0.0:1788863764.367462:0:10355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863764.367474:0:10355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+21:3643:x1875759226588160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863764.367496:0:10355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863764.367522:0:10355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d90200/0xf569beb9d4b69002 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68ffb expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863764.367541:0:10355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863764.367605:0:10355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:3643:x1875759226588160:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863764.367613:0:10355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863764.367665:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226588160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863764.368019:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.368027:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.368030:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.368069:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368115:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368124:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368132:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368150:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788863764.368158:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788863764.368184:0:15071:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788863764.368231:0:15071:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788863764.368236:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788863764.368243:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863764.368250:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788863764.368257:0:15071:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e5425ce800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863764.368275:0:15071:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e541e75000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863764.368281:0:15071:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e67ad5c800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863764.368286:0:15071:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e680de0800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788863764.368296:0:15071:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff89e543a46000 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 192.168.204.35@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863764.368301:0:15071:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff89e543424800 7a6822fa-e36f-4316-b7e3-4bba6134cbda 192.168.204.35@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1788863764.368307:0:15071:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff89e671350000) has exports, disconnecting them 00000020:00080000:3.0:1788863764.368313:0:15071:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e5425ce800), last request at 1788863760 00000020:00000080:3.0:1788863764.368323:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68c12 00000100:00080000:3.0:1788863764.368344:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e541e71000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788863764.368403:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863764.368410:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368419:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650115200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863764.368423:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368433:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863764.368441:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863764.368456:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863764.368459:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788863764.368461:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788863764.368500:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368508:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863764.368535:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368542:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650115200/0xf569beb9d4b68861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68868 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863764.368556:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.368558:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863764.368560:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863764.368577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226588288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863764.368642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788863764.368711:0:15071:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5425ce800): rc 0 00000020:00000080:3.0:1788863764.368715:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e5425ce800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788863764.368737:0:15071:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e541e75000), last request at 1788863760 00000020:00000080:3.0:1788863764.368742:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68aec 00000100:00080000:3.0:1788863764.368748:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e541e70000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788863764.368763:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788863764.368771:0:15071:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e541e75000): rc 0 00000020:00000080:3.0:1788863764.368772:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e541e75000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788863764.368777:0:15071:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e67ad5c800), last request at 1788863516 00000020:00000080:3.0:1788863764.368781:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b689e9 00000100:00080000:3.0:1788863764.368793:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e67ad5b000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788863764.368806:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788863764.368814:0:15071:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e67ad5c800): rc 0 00000020:00000080:3.0:1788863764.368816:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e67ad5c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788863764.368821:0:15071:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e680de0800), last request at 1788863516 00000020:00000080:3.0:1788863764.368825:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b689b8 00000100:00080000:3.0:1788863764.368829:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e681bbf800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788863764.368838:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788863764.368846:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1788863764.368947:0:15071:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e680de0800): rc 0 00000004:00000080:3.0:1788863764.368955:0:15071:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa4a9c7b13ae0 00000100:00080000:3.0:1788863764.368977:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788863764.368981:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1788863764.370219:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588288 00000020:00000080:0.0:1788863764.370272:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425ce800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788863764.370389:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541e75000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788863764.370415:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67ad5c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788863764.370446:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e541e71000 for lustre-MDT0000 00000020:00000080:0.0:1788863764.370460:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e541e70000 for lustre-MDT0000 00000020:00000080:0.0:1788863764.370463:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67ad5b000 for lustre-MDT0000 00000100:00100000:2.0:1788863764.372450:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588288 00000100:00100000:2.0:1788863764.372571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788863764.372589:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+20:3640:x1875759226588288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863764.372611:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863764.372639:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115e00/0xf569beb9d4b68868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68861 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863764.372662:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863764.372776:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:3640:x1875759226588288:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (4133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863764.372784:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788863764.372835:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863764.374403:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226588288:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788863764.379427:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788863764.379477:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e66d49f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788863764.380433:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226588416:0@lo:39:umount.0 00000100:00100000:2.0:1788863764.380536:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863764.381012:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588416 00000100:00100000:3.0:1788863764.381025:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588416 00000100:00100000:3.0:1788863764.381157:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788863764.381171:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875759226588416:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788863764.381643:0:6542:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68a44 00000100:00080000:3.0:1788863764.381657:0:6542:0:(import.c:65:import_set_state_nolock()) ffff89e680de1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863764.381701:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788863764.381925:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3639:x1875759226588416:12345-0@lo:39:umount.0 Request processed in 756us (1389us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788863764.381946:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1788863764.382369:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e66d49f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788863764.382392:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226588416:0@lo:39:umount.0 00010000:00010000:0.0:1788863764.382825:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863764.382975:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788863764.382981:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788863764.383013:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788863764.383114:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788863764.383149:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e676347800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788863764.383171:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788863764.383174:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788863764.383193:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788863764.383232:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226588544:0@lo:9:umount.0 00000100:00080000:1.0:1788863764.383269:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788863764.383283:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e543421000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788863764.383315:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff89e671350000) has no exports 00000100:00100000:2.0:1788863764.383403:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863764.383464:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226588672:0@lo:9:umount.0 00000100:00100000:2.0:1788863764.383495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863764.384067:0:8452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588544 00000100:00100000:2.0:1788863764.384140:0:8450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588672 00000100:00100000:2.0:1788863764.384149:0:8450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588672 00000100:00080000:0.0:1788863764.384234:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863764.384250:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788863764.384922:0:8452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588544 00000100:00100000:3.0:1788863764.385114:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788863764.385124:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863764.385127:0:8452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875759226588544:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788863764.385189:0:8452:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68b94 00000100:00080000:3.0:1788863764.385203:0:8452:0:(import.c:65:import_set_state_nolock()) ffff89e5425ce000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788863764.385316:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863764.385363:0:8450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875759226588672:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788863764.385397:0:8450:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68cd6 00000100:00080000:2.0:1788863764.385405:0:8450:0:(import.c:65:import_set_state_nolock()) ffff89e681a79000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788863764.385448:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788863764.385455:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788863764.385719:0:8450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3639:x1875759226588672:12345-0@lo:9:umount.0 Request processed in 1457us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863764.385732:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788863764.385783:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e543421000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788863764.385809:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788863764.385812:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863764.385818:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226588672:0@lo:9:umount.0 00000001:00000004:3.0:1788863764.386408:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788863764.386635:0:8452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3639:x1875759226588544:12345-0@lo:9:umount.0 Request processed in 1509us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863764.386645:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788863764.386691:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676347800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788863764.386711:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788863764.386716:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863764.386722:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226588544:0@lo:9:umount.0 00000020:00080000:0.0:1788863764.394464:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff89e671350000) has no exports 00000020:00000080:0.0:1788863764.470602:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b688bc 00000020:00000080:0.0:1788863764.470620:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e655c65800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788863764.470862:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788863764.470985:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863764.470996:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788863764.471002:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff89e676138000) has no exports 00000020:00000080:3.0:1788863764.471037:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c65800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788863764.475701:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b688b5 00000020:00000080:3.0:1788863764.475717:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e676125800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788863764.475766:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676125800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788863764.475805:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863764.475817:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788863764.475820:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e676124800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788863764.475823:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676124800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788863764.475828:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000040:00080000:2.0:1788863764.588517:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863764.651423:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788863764.973593:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863764.973604:0:8444:0:(genops.c:885:class_export_put()) final put ffff89e5425c8000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788863764.973624:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:2.0:1788863764.973627:0:8444:0:(genops.c:885:class_export_put()) final put ffff89e67f895000/7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000001:00100000:2.0:1788863764.974352:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863764.974356:0:9530:0:(genops.c:885:class_export_put()) final put ffff89e681a7d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788863764.974378:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:2.0:1788863764.974381:0:9530:0:(genops.c:885:class_export_put()) final put ffff89e675662800/7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:0.0:1788863764.974652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425c8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788863764.974784:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67f895000/7a6822fa-e36f-4316-b7e3-4bba6134cbda for lustre-OST0000 00000020:00000080:0.0:1788863764.974823:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e681a7d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788863764.974841:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e675662800/7a6822fa-e36f-4316-b7e3-4bba6134cbda for lustre-OST0001 00000020:00000080:0.0:1788863764.974855:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425ce000 for lustre-OST0000 00000020:00000080:0.0:1788863764.974859:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67f897800 for lustre-OST0000 00000020:00000080:0.0:1788863764.974861:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e681a79000 for lustre-OST0001 00000020:00000080:0.0:1788863764.974864:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e675667000 for lustre-OST0001 00000001:00100000:0.0:1788863764.985622:0:6516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788863764.985632:0:6516:0:(genops.c:885:class_export_put()) final put ffff89e680de0800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788863764.985672:0:6516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000001:00080000:0.0:1788863764.985680:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788863764.985683:0:6516:0:(genops.c:885:class_export_put()) final put ffff89e543a46000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000001:00100000:0.0:1788863764.985691:0:6516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000001:00080000:0.0:1788863764.985697:0:6516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788863764.985704:0:6516:0:(genops.c:885:class_export_put()) final put ffff89e543424800/7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:2.0:1788863764.985834:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788863764.985944:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543a46000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d for lustre-MDT0000 00000020:00000080:2.0:1788863764.985968:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543424800/7a6822fa-e36f-4316-b7e3-4bba6134cbda for lustre-MDT0000 00000020:00000080:2.0:1788863764.985996:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e681bbf800 for lustre-MDT0000 00000020:00000080:2.0:1788863764.986001:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543a47800 for lustre-MDT0000 00000020:00000080:2.0:1788863764.986006:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67aeec800 for lustre-MDT0000 00000001:00100000:3.0:1788863764.986513:0:7467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788863764.986521:0:7467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788863764.986525:0:7467:0:(genops.c:885:class_export_put()) final put ffff89e681bb9000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788863764.986543:0:7467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000001:00080000:3.0:1788863764.986547:0:7467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788863764.986550:0:7467:0:(genops.c:885:class_export_put()) final put ffff89e543a44000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d 00000001:00100000:3.0:1788863764.986555:0:7467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000001:00080000:3.0:1788863764.986561:0:7467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788863764.986563:0:7467:0:(genops.c:885:class_export_put()) final put ffff89e5439c0800/7a6822fa-e36f-4316-b7e3-4bba6134cbda 00000020:00000080:0.0:1788863764.986613:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e681bb9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788863764.986667:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543a44000/37081b3d-46f9-4ae6-9395-ddf0b5561d0d for lustre-MDT0001 00000020:00000080:0.0:1788863764.986692:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5439c0800/7a6822fa-e36f-4316-b7e3-4bba6134cbda for lustre-MDT0001 00000020:00000080:0.0:1788863764.986716:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e680de1000 for lustre-MDT0001 00000020:00000080:0.0:1788863764.986720:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543a46800 for lustre-MDT0001 00000020:00000080:0.0:1788863764.986724:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5439c0000 for lustre-MDT0001 00000100:00100000:1.0:1788863765.484312:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863765.484340:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226588800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863765.484430:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863765.484503:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588800 00000100:00100000:2.0:1788863765.484512:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588800 00000100:00100000:2.0:1788863765.484588:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788863765.484598:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226588800:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788863765.484711:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788863765.484782:0:8454:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788863765.484857:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226588800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 260us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863765.484865:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788863765.485001:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226588800:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788863765.675366:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863765.997131:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226589184:0@lo:400:kworker.0 00000100:00100000:1.0:1788863765.997238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863765.997315:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226589696:0@lo:400:kworker.0 00000100:00100000:1.0:1788863765.997338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863765.997380:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788863765.997385:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226589312:0@lo:400:kworker.0 00000100:00100000:1.0:1788863765.997406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863765.997420:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226589824:0@lo:400:kworker.0 00000100:00100000:1.0:1788863765.997437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863765.997465:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589184 00000100:00100000:1.0:1788863765.997473:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589184 00000100:00100000:1.0:1788863765.997504:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589696 00000100:00100000:1.0:1788863765.997507:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589696 00000100:00100000:1.0:1788863765.997514:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589312 00000100:00100000:1.0:1788863765.997516:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589312 00000100:00100000:1.0:1788863765.997523:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589824 00000100:00100000:1.0:1788863765.997525:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589824 00000100:00100000:1.0:1788863765.997554:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788863765.997564:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226589824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863765.997622:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226589824:12345-0@lo:400:kworker.0 Request processed in 61us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863765.997629:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788863765.997646:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788863765.997649:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875759226589184:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788863765.997653:0:6536:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788863765.997678:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875759226589184:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788863765.997703:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788863765.997717:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788863765.997721:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875759226589696:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788863765.997725:0:6536:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788863765.997746:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875759226589696:12345-0@lo:400:kworker.0 Request processed in 25us (408us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788863765.997752:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788863765.997761:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788863765.997764:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875759226589312:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788863765.997769:0:6536:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788863765.997788:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875759226589312:12345-0@lo:400:kworker.0 Request processed in 22us (381us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788863765.997793:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1788863765.997823:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788863765.997828:0:3640:0:(import.c:65:import_set_state_nolock()) ffff89e5425cf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788863765.997831:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788863765.998386:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226589056:0@lo:400:kworker.0 00000100:00100000:0.0:1788863765.998428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863765.998453:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226589568:0@lo:400:kworker.0 00000100:00100000:0.0:1788863765.998476:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863765.998496:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788863765.998501:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226588928:0@lo:400:kworker.0 00000100:00100000:0.0:1788863765.998525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863765.998549:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226589440:0@lo:400:kworker.0 00000100:00100000:0.0:1788863765.998570:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863765.998586:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226589952:0@lo:400:kworker.0 00000100:00100000:0.0:1788863765.998622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863765.998650:0:9795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589056 00000100:00100000:0.0:1788863765.998655:0:9795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589056 00000100:00100000:0.0:1788863765.998686:0:9795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788863765.998691:0:9795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875759226589056:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788863765.998696:0:9795:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788863765.998727:0:9795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875759226589056:12345-0@lo:400:kworker.0 Request processed in 35us (299us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788863765.998734:0:9795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1788863765.998753:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863765.998777:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788863765.998780:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e67631d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788863765.998784:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788863765.998790:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e67631d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863765.998793:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 183 00000100:00080000:0.0:1788863765.998803:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89e67631d000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863765.998829:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544006d80 x1875759226590080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863765.998849:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226589056:0@lo:400:kworker.0 00000100:00100000:0.0:1788863765.998872:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226590080:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788863765.998900:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863765.998926:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589440 00000100:00100000:0.0:1788863765.998930:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589440 00000100:00100000:0.0:1788863765.998959:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788863765.998965:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226589440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863765.999010:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226589440:12345-0@lo:400:kworker.0 Request processed in 45us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863765.999017:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:0.0:1788863765.999031:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788863765.999046:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7b100 x1875759226589440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863765.999056:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226589440:0@lo:400:kworker.0 00000100:00100000:3.0:1788863766.000388:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226590080 00000100:00100000:3.0:1788863766.000399:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226590080 00000100:00100000:3.0:1788863766.000443:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788863766.000449:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226590080:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788863766.000465:0:6542:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788863766.000695:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589568 00000100:00100000:2.0:1788863766.000706:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589568 00000100:00100000:2.0:1788863766.000750:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226589952 00000100:00100000:2.0:1788863766.000753:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226589952 00000100:00100000:2.0:1788863766.000787:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788863766.000794:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226589568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863766.000861:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226589568:12345-0@lo:400:kworker.0 Request processed in 68us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863766.000868:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788863766.000893:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788863766.000900:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226589952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863766.000929:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226589952:12345-0@lo:400:kworker.0 Request processed in 30us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863766.000935:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788863766.000956:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226588928 00000100:00100000:2.0:1788863766.000959:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226588928 00000100:00100000:2.0:1788863766.000984:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788863766.000991:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:3643:x1875759226588928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863766.001020:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e671b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc+19:3643:x1875759226588928:12345-0@lo:400:kworker.0 Request processed in 30us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863766.001025:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00080000:2.0:1788863766.001058:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863766.001123:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226588928:0@lo:400:kworker.0 00000100:00100000:2.0:1788863766.001137:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226589952:0@lo:400:kworker.0 00000100:00100000:2.0:1788863766.001147:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226589568:0@lo:400:kworker.0 00000100:00080000:1.0:1788863766.028945:0:3640:0:(import.c:65:import_set_state_nolock()) ffff89e5425cf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863766.028959:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 204 00000100:00100000:3.0:1788863766.029408:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226590080:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28955us (30504us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788863766.029421:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1788863766.029616:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67631d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863766.029621:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863766.029626:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226590080:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788863766.029890:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425cf800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863766.029932:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b8000 x1875759226590208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863766.029960:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226589312:0@lo:400:kworker.0 00010000:00080000:1.0:1788863766.029981:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7bb80 x1875759226589824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863766.030096:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226590208:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788863766.030140:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863766.030234:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226590208 00000100:00100000:3.0:1788863766.030241:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226590208 00000100:00100000:3.0:1788863766.030283:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788863766.030290:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e655c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226590208:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788863766.030308:0:6536:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788863766.030364:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e655c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226590208:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 73us (224us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788863766.030491:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788863766.030557:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226589824:0@lo:400:kworker.0 00000100:00080000:1.0:1788863766.030574:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788863766.030578:0:3640:0:(import.c:65:import_set_state_nolock()) ffff89e680de3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788863766.030582:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788863766.030586:0:3640:0:(import.c:65:import_set_state_nolock()) ffff89e680de3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863766.030590:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 183 00000100:00080000:1.0:1788863766.030597:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89e680de3800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863766.030614:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b9f80 x1875759226590336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863766.030625:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226589184:0@lo:400:kworker.0 00000100:00080000:1.0:1788863766.030639:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788863766.030642:0:3640:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788863766.030645:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788863766.030648:0:3640:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863766.030651:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 229 00000100:00080000:1.0:1788863766.030656:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e543427800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863766.030668:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b8380 x1875759226590464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863766.030676:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226589696:0@lo:400:kworker.0 00000100:00100000:0.0:1788863766.030763:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226590336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788863766.030792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863766.030937:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226590464:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788863766.030963:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788863766.031629:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425cf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863766.031634:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863766.031638:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226590208:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788863766.031725:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226590336 00000100:00100000:3.0:1788863766.031731:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226590336 00000100:00100000:3.0:1788863766.031835:0:10368:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226590464 00000100:00100000:3.0:1788863766.031839:0:10368:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226590464 00000100:00100000:2.0:1788863766.031871:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788863766.031878:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226590336:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788863766.031904:0:6538:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788863766.031961:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226590336:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 81us (1167us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788863766.031968:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788863766.031982:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788863766.031987:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226590464:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788863766.031994:0:6538:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788863766.032028:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226590464:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (1064us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788863766.032034:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788863766.032101:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e680de3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863766.032107:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863766.032116:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226590336:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788863766.032129:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863766.032132:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863766.032135:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226590464:0@lo:38:ptlrpcd_00_00.0 00000020:01000000:0.0:1788863766.507843:0:15071:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e5436c2c00 - data ffff89e671f09bd0/ffff89e543983800 00000020:01000000:0.0:1788863766.507999:0:15071:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e6455a3c00 - data ffff89e671ce0510/ffff89e676152c00 00000100:00100000:0.0:1788863766.512352:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226590592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863766.512439:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863766.513063:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226590592 00000100:00100000:1.0:1788863766.513109:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226590592 00000100:00100000:1.0:1788863766.513182:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788863766.513193:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226590592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863766.513230:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788863766.513288:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226590592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863766.513295:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788863766.513361:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226590592:0@lo:13:osp-pre-1-1.0 00000001:00000004:0.0:1788863766.544326:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1788863766.579307:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788863766.579316:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788863766.579344:0:15071:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89e5440c1180 x1875759226588416/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788863774 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863766.579367:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788863766.581636:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788863766.581643:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788863766.581667:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863766.581669:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788863766.581972:0:8602:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788863766.581978:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788863766.581990:0:8602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788863766.582546:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788863766.582551:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788863766.582565:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863766.582568:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788863766.582940:0:10004:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788863766.582944:0:10004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788863766.582953:0:10004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788863766.587234:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68884 00000020:00000080:0.0:1788863766.587248:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e65d9d1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788863766.587395:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e65d9d1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788863766.591705:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68899 00000020:00000080:0.0:1788863766.591717:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e655c67000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788863766.592490:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788863766.592495:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c67000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788863766.592498:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863766.592509:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788863766.592514:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff89e671353380) has no exports 00000004:01000000:0.0:1788863766.593005:0:15071:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788863766.593016:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68ccf 00000020:00000080:0.0:1788863766.593022:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e543a45000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788863766.593144:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788863766.593161:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863766.593171:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788863766.593192:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff89e543a1b380) has no exports 00000020:00000080:0.0:1788863766.593199:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68cc8 00000020:00000080:0.0:1788863766.593204:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e543422000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788863766.594072:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543a45000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788863766.594617:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543422000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788863766.594692:0:15071:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788863766.594706:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788863766.594710:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788863766.594716:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863766.594719:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788863766.594795:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863766.594806:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788863766.594814:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68b8d 00000020:00000080:0.0:1788863766.594820:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e5425b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863766.594852:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543421000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788863766.594859:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e54399f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863766.594861:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e54399f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788863766.594865:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788863766.595019:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788863766.595025:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863766.595030:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788863766.595033:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff89e6763c3380) has no exports 00000020:00000080:0.0:1788863766.595040:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68b86 00000020:00000080:0.0:1788863766.595051:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e541f54800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788863766.595066:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788863766.595549:0:15071:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788863766.595553:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788863766.595556:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788863766.595560:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863766.595561:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863766.595585:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541f54800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788863766.595672:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863766.595680:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788863766.595691:0:15071:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788863766.595696:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68a3d 00000020:00000080:0.0:1788863766.595701:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e67ae84800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863766.595724:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e676347800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788863766.595730:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e541f56800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863766.595732:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541f56800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788863766.595737:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788863766.595843:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788863766.595847:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863766.595852:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788863766.595855:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff89e6763c19c0) has no exports 00000020:00000080:0.0:1788863766.595859:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68a36 00000020:00000080:0.0:1788863766.595863:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e66d49d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788863766.595879:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67ae84800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788863766.596518:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e66d49d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788863766.597001:0:15071:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788863766.597006:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788863766.597009:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788863766.597015:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863766.597052:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e66d49f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788863766.597052:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863766.597060:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788863766.597064:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e655c65000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863766.597066:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c65000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788863766.597072:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788863766.597202:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863766.597207:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788863766.597211:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e66d498000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863766.598880:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff89e66d498000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788863766.598888:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863766.599197:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b688a0 00000020:00000080:3.0:1788863766.599205:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e655c62800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788863766.599214:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788863766.599401:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863766.599409:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788863766.599412:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff89e6713519c0) has no exports 00000020:00000080:3.0:1788863766.599433:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863766.599438:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788863766.599442:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b688a7 00000020:00000080:3.0:1788863766.599446:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e655c63000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788863766.599453:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e64a89a800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788863766.599456:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e64a89a800 3 00000020:01000004:3.0:1788863766.599459:0:15071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e64a89a800 from lustre-MDT0000 00000020:00000080:3.0:1788863766.599482:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863766.599484:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788863766.599486:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e65d9d4800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788863766.599488:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff89e65d9d4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788863766.599495:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788863766.599538:0:15071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788863766.599546:0:15071:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788863766.599549:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788863766.599551:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863766.599554:0:15071:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788863766.599560:0:15071:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff89e650816800 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863766.599564:0:15071:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff89e65d58b380) has exports, disconnecting them 00000020:00080000:3.0:1788863766.599577:0:15071:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89e650816800), last request at 1788863495 00000020:00000080:3.0:1788863766.599593:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68845 00000020:00010000:3.0:1788863766.599597:0:15071:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e650816800: total 2 00000020:00000080:2.0:1788863766.599691:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c62800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788863766.599696:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e66d49d000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788863766.599698:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e66d49d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788863766.599703:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788863766.599759:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c63000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:3.0:1788863766.601156:0:15071:0:(import.c:65:import_set_state_nolock()) ffff89e661d25000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788863766.601178:0:15071:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e650816800): rc 0 00000020:00010000:0.0:1788863766.601183:0:6525:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e650816800: total 0 00000020:00080000:3.0:1788863766.601184:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff89e65d58b380) has no exports 00010000:00010000:0.0:1788863766.601235:0:6525:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e650816800, canceled 0 locks, left on hash table 13. 00000100:00100000:3.0:1788863766.601264:0:6532:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff89e650154600:6532] 2 exiting: rc = 0 00010000:00010000:0.0:1788863766.601275:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98e00/0xf569beb9d4b68d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68d3f expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601294:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167c800/0xf569beb9d4b68d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68d4d expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601305:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d000/0xf569beb9d4b68c66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68c5f expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601317:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98400/0xf569beb9d4b68db6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68daf expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601327:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b68d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68d69 expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601350:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99a00/0xf569beb9d4b68d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68d5b expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601360:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167de00/0xf569beb9d4b68941 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6893a expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601372:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640030400/0xf569beb9d4b68fd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68fd1 expref: 7 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601382:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650114000/0xf569beb9d4b68d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68d77 expref: 6 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601392:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650115a00/0xf569beb9d4b68d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68d85 expref: 5 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601403:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d91c00/0xf569beb9d4b68ff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68fed expref: 4 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863766.601414:0:6529:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff89e671329400:6529] 0 exiting: rc = 1 00010000:00010000:0.0:1788863766.601425:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641536400/0xf569beb9d4b6894f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68948 expref: 3 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601439:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031600/0xf569beb9d4b68fe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b68fdf expref: 2 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863766.601449:0:6525:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e650816800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788863766.601463:0:6525:0:(genops.c:885:class_export_put()) final put ffff89e650816800/9205f27e-a2bf-4f82-a9c9-67d4609e8ffc 00000100:00100000:2.0:1788863766.601471:0:6530:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff89e671328400:6530] 1 exiting: rc = 0 00010000:00010000:0.0:1788863766.601483:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863766.601485:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863766.601487:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788863766.601859:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e650816800/9205f27e-a2bf-4f82-a9c9-67d4609e8ffc for MGS 00000020:00000080:3.0:1788863766.601894:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e661d25000 for MGS 00000100:00100000:3.0:1788863766.601934:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601956:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601964:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601969:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601974:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601981:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601987:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601992:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.601998:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602003:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602008:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602013:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602019:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602026:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602034:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602041:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602048:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602055:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602062:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602070:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602103:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602114:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602124:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602129:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602139:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602146:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602151:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602156:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602167:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602183:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602188:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602194:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602199:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602204:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602208:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602214:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602223:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602228:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602233:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602237:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602242:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602246:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602251:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602256:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602261:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602265:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602270:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602274:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602279:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602283:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602287:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602292:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602296:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602300:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602305:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602309:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602313:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602317:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602322:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602326:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602340:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602345:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602349:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863766.602359:0:15071:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788863766.610521:0:15071:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e5437a1de0 - data ffff89e671f22288/ffff89e54394e800 00000020:01000000:3.0:1788863766.613186:0:15071:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e6455a3540 - data ffff89e671c6b870/ffff89e65e45f000 00000020:00000080:3.0:1788863766.617795:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68829 00000020:00000080:3.0:1788863766.617808:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e64a89f000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788863766.617829:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e64a89a800 from MGS, refs=2 00000020:01000004:3.0:1788863766.617832:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e64a89a800 2 00000020:01000004:3.0:1788863766.617835:0:15071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e64a89a800 from MGS 00000020:00000080:3.0:1788863766.617856:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863766.617863:0:15071:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788863766.617865:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e64a89f800/MGS 00000020:00000080:3.0:1788863766.617868:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff89e64a89f800/MGS for MGS 00000020:01000000:3.0:1788863766.617874:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788863766.617939:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788863766.617951:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863766.617956:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788863766.617963:0:15071:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89e676192800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863766.617969:0:15071:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff89e65d588000) has exports, disconnecting them 00000020:00080000:3.0:1788863766.617973:0:15071:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89e676192800), last request at 1788863496 00000020:00000080:3.0:1788863766.617978:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b688f4 00000020:00080000:3.0:1788863766.617986:0:15071:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e676192800): rc 0 00000020:00000080:3.0:1788863766.617990:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e676192800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788863766.618244:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e64a89f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788863766.618255:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676192800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788863766.619129:0:15071:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788863766.619135:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863766.619140:0:15071:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788863766.619145:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788863766.619167:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e676197800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788863766.619295:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863766.619300:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788863766.619304:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e67570f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788863766.619306:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67570f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788863766.619311:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788863766.619383:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e64a89a800 1 00000020:00000080:2.0:1788863766.619387:0:15071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6881b 00000020:00000080:2.0:1788863766.619391:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e64a899000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788863766.619398:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788863766.619404:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e64a899000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788863766.619411:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863766.619414:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788863766.619416:0:15071:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff89e65862cd40) has no exports 00000020:00000080:0.0:1788863766.655445:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863766.655459:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788863766.655465:0:15071:0:(genops.c:885:class_export_put()) final put ffff89e675665800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788863766.655469:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff89e675665800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788863766.655476:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788863766.655598:0:15071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e64a89a000 00000020:02000400:0.0:1788863766.655663:0:15071:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788863766.699647:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863767.725064:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863768.748024:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863769.771778:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788863770.431011:0:15272:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788863770.438332:0:15272:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788863770.438387:0:15272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.438403:0:15272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.438410:0:15272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.438417:0:15272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.438515:0:15272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788863770.438589:0:15272:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788863770.438625:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863770.438630:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788863770.438636:0:15272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788863770.438643:0:15272:0:(import.c:65:import_set_state_nolock()) ffff89e680de3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788863770.438648:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863770.438650:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788863770.438653:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788863770.440524:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863770.440537:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863770.440550:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863770.440554:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863770.440565:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863770.440592:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863770.440599:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863770.440602:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788863770.440607:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788863770.440656:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863770.440664:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863770.440697:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863770.440705:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d91600/0xf569beb9d4b68d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d7e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863770.440719:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863770.440721:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863770.440723:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863770.440747:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226590720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863770.440819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863770.440856:0:15272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.440868:0:15272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.440887:0:15272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.440895:0:15272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863770.440902:0:6524:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226590720 00000100:00100000:0.0:1788863770.440910:0:6524:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226590720 00010000:00010000:2.0:1788863770.440924:0:15272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863770.440933:0:15272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.440941:0:15272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.440949:0:15272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.440956:0:15272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863770.440958:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863770.440971:0:6524:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1875759226590720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788863770.440978:0:6524:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863770 with bad export cookie 17683875117193922629 00010000:00010000:2.0:1788863770.440984:0:15272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788863770.440992:0:15272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.441002:0:15272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.441008:0:15272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441550:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863770.441558:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441567:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d91800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863770.441570:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441577:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863770.441585:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863770.441604:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788863770.441610:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788863770.441625:0:15272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441632:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441640:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863770.441643:0:15272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788863770.441652:0:15272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.441663:0:15272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441663:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441679:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d91800/0xf569beb9d4b68d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68d8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441690:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863770.441693:0:15272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441694:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.441710:0:15272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.441712:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863770.441718:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863770.441722:0:15272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788863770.441729:0:15272:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788863770.441730:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863770.441733:0:15272:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 10000000:00010000:1.0:1788863770.441742:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863770.441748:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788863770.441750:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788863770.441753:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:01000004:2.0:1788863770.441766:0:15272:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788863770.441771:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788863770.441776:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788863770.441777:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788863770.441782:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:1.0:1788863770.441786:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1788863770.441792:0:15272:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff89e543422800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788863770.441800:0:15272:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff89e5425b7000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788863770.441805:0:15272:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff89e65d58cd40) has exports, disconnecting them 00010000:00010000:1.0:1788863770.441807:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788863770.441811:0:15272:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89e543422800), last request at 1788863765 00000020:00000080:2.0:1788863770.441822:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68c27 00010000:00010000:1.0:1788863770.441822:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b68c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68c66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788863770.441848:0:15272:0:(import.c:65:import_set_state_nolock()) ffff89e543427000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788863770.441892:0:15272:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e543422800): rc 0 00000020:00000080:2.0:1788863770.441896:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e543422800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788863770.441920:0:15272:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89e5425b7000), last request at 1788863765 00000020:00000080:2.0:1788863770.441924:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68b01 00000100:00080000:2.0:1788863770.441930:0:15272:0:(import.c:65:import_set_state_nolock()) ffff89e5425b6800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788863770.441937:0:15272:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5425b7000): rc 0 00000020:00000080:2.0:1788863770.441939:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e5425b7000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788863770.441947:0:15272:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa4a9c1c3fae0 00000100:00080000:2.0:1788863770.441967:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863770.441971:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788863770.442378:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863770.442382:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442389:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863770.442392:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442400:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863770.442406:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863770.442411:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788863770.442414:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788863770.442416:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788863770.442444:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442450:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863770.442458:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442471:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640031000/0xf569beb9d4b68fed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b68ff4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442480:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863770.442483:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442489:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030e00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863770.442492:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442499:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863770.442505:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863770.442510:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788863770.442512:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788863770.442515:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788863770.442528:0:9549:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442534:0:9549:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863770.442541:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442546:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030e00/0xf569beb9d4b68948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6894f expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863770.442568:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863770.442570:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863770.442572:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863770.442588:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226591104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863770.442641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863770.442686:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863770.442692:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226590976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863770.442715:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863770.442743:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226591104 00000100:00100000:1.0:1788863770.442749:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226591104 00000100:00100000:1.0:1788863770.442776:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226590976 00000100:00100000:1.0:1788863770.442779:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226590976 00000100:00100000:1.0:1788863770.442791:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863770.442797:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875759226591104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788863770.442803:0:6522:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863770 with bad export cookie 17683875117193922629 00000100:00100000:1.0:1788863770.442846:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875759226591104:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (204us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788863770.442853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863770.442871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863770.442875:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e65e448450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875759226590976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788863770.442879:0:6522:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863770 with bad export cookie 17683875117193922629 00000100:00100000:1.0:1788863770.442903:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e65e448450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875759226590976:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (186us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788863770.442908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788863770.442939:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788863770.442944:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e646758800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788863770.442954:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788863770.443610:0:15272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788863770.443617:0:15272:0:(import.c:65:import_set_state_nolock()) ffff89e67631d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788863770.443763:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788863770.443768:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1788863770.443780:0:15272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788863770.443853:0:15272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788863770.443869:0:15272:0:(import.c:65:import_set_state_nolock()) ffff89e67aeef800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788863770.443884:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788863770.443886:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788863770.443894:0:15272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788863770.443949:0:15272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788863770.443957:0:15272:0:(import.c:65:import_set_state_nolock()) ffff89e54399c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788863770.443981:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff89e65d58cd40) has no exports 00000020:00000080:3.0:1788863770.449013:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543422800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:2.0:1788863770.449100:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788863770.449243:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788863770.449284:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543427000 for lustre-MDT0001 00000020:00000080:3.0:1788863770.449290:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425b6800 for lustre-MDT0001 00000100:00080000:1.0:1788863770.470272:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788863770.470278:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788863770.470288:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dd180 x1875759226590720/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863786 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863770.470303:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e66d4ba300 x1875759226591104/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863786 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863770.470313:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e66d4b9f80 x1875759226590976/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863786 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863770.470398:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:0:1875759226591232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863770.470423:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3640:1875759226590720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863770.470478:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788863770.471601:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788863770.471606:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788863770.471608:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788863770.471612:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e646758800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863770.471619:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 162 00000100:00080000:1.0:1788863770.471633:0:3643:0:(import.c:666:import_select_connection()) MGC192.168.204.135@tcp: import ffff89e646758800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863770.471667:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4bbb80 x1875759226591616/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863770.471694:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226591104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863770.471711:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3643:1875759226590976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863770.473940:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:0:1875759226590848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863770.474156:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226591360:0@lo:9:umount.0 00000100:00100000:2.0:1788863770.474228:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863770.474409:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226591488:0@lo:9:umount.0 00000100:00100000:2.0:1788863770.474433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863770.474451:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3639:1875759226591616:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788863770.474467:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875759226591616 offset 0 length 520: 4 00000100:00100000:2.0:1788863770.474533:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226591360 00000100:00100000:2.0:1788863770.474541:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226591360 00000100:00100000:2.0:1788863770.474590:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226591488 00000100:00100000:2.0:1788863770.474594:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226591488 00000100:00100000:2.0:1788863770.474617:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788863770.474626:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875759226591360:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788863770.474652:0:8451:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68b4e 00000100:00080000:2.0:1788863770.474663:0:8451:0:(import.c:65:import_set_state_nolock()) ffff89e5425b2000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788863770.474695:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788863770.474705:0:8606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875759226591488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788863770.474761:0:8606:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68c90 00000100:00080000:3.0:1788863770.474769:0:8606:0:(import.c:65:import_set_state_nolock()) ffff89e54343d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863770.475414:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788863770.475569:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3639:x1875759226591360:12345-0@lo:9:umount.0 Request processed in 942us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863770.475578:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788863770.475603:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863770.475608:0:6533:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863770.475644:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67aeef800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788863770.475657:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788863770.475661:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000400:00000100:0.0:1788863770.475662:0:6524:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875759226590720 offset 224 length 224: 4 00000100:00100000:2.0:1788863770.475668:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226591360:0@lo:9:umount.0 00000100:00100000:0.0:1788863770.475682:0:6524:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1875759226590720:12345-0@lo:103:ldlm_bl.0 Request processed in 34710us (34862us total) trans 0 rc -107/-107 00000001:00000004:3.0:1788863770.475697:0:8606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788863770.475704:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788863770.475822:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863770.475842:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e54399c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788863770.475860:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788863770.475862:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863770.475865:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226591488:0@lo:9:umount.0 00010000:00010000:0.0:1788863770.476213:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863770.476428:0:8606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3639:x1875759226591488:12345-0@lo:9:umount.0 Request processed in 1114us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863770.476442:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000020:00080000:2.0:1788863770.485437:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff89e65d58cd40) has no exports 00000020:01000000:3.0:1788863770.530749:0:15272:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e542bf0000 - data ffff89e671f42798/ffff89e54377dc00 00000020:01000000:3.0:1788863770.530906:0:15272:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e67ac1c7e0 - data ffff89e671dfb288/ffff89e67accb400 00000001:00000004:2.0:1788863770.554395:0:15272:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788863770.605034:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863770.605043:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788863770.605051:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788863770.607461:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788863770.607468:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788863770.607490:0:15272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863770.607492:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788863770.608116:0:8597:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788863770.608122:0:8597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788863770.608133:0:8597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788863770.608863:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788863770.608881:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788863770.608899:0:15272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863770.608902:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788863770.609628:0:10000:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788863770.609633:0:10000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788863770.609643:0:10000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788863770.611349:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6896b 00000020:00000080:3.0:1788863770.611360:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e67570b000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788863770.613448:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68980 00000020:00000080:3.0:1788863770.613459:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e680de5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788863770.613625:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67570b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788863770.619061:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788863770.619105:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863770.619117:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788863770.619125:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff89e65d5899c0) has no exports 00000004:01000000:3.0:1788863770.619495:0:15272:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788863770.619521:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68c89 00000020:00000080:3.0:1788863770.619530:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e54399a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863770.620952:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788863770.621116:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788863770.621154:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863770.621183:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788863770.621188:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff89e5428ecd40) has no exports 00000020:00000080:3.0:1788863770.621196:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68c82 00000020:00000080:3.0:1788863770.621203:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e54399b800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788863770.621495:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e54399a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1788863770.622019:0:15272:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788863770.622024:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788863770.622029:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788863770.622035:0:15272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863770.622036:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863770.622529:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e54399b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788863770.622653:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863770.622664:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788863770.622672:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68b47 00000020:00000080:3.0:1788863770.622681:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e5425ca800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863770.622710:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e54399c000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788863770.622722:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e543420800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863770.622724:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543420800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788863770.622741:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788863770.622973:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788863770.622978:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863770.622984:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788863770.622988:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff89e680ddcd40) has no exports 00000020:00000080:3.0:1788863770.622995:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68b40 00000020:00000080:3.0:1788863770.623001:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e67aeed000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788863770.623027:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425ca800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1788863770.623720:0:15272:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788863770.623725:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788863770.623729:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788863770.623734:0:15272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863770.623736:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863770.623774:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67aeed000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788863770.623876:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863770.623884:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788863770.623900:0:15272:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788863770.623907:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b689a3 00000020:00000080:3.0:1788863770.623923:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e681bbf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863770.624025:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67aeef800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788863770.624033:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e67aeed800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863770.624035:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67aeed800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788863770.624041:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788863770.624452:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788863770.624457:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863770.624464:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788863770.624467:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff89e6761399c0) has no exports 00000020:00000080:3.0:1788863770.624474:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6899c 00000020:00000080:3.0:1788863770.624479:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e681a78000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788863770.624504:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e681bbf000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00010000:01000000:0.0:1788863770.633202:0:15272:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788863770.633211:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863770.633216:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788863770.633225:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863770.634129:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e681a78000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788863770.634580:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863770.634592:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788863770.634748:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67631d000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788863770.634758:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e681a7e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863770.634761:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e681a7e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788863770.634767:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788863770.634970:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863770.634976:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788863770.634979:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e676197000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788863770.634982:0:15272:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676197000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788863770.634991:0:15272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788863770.635138:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68987 00000020:00000080:0.0:1788863770.635146:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e680de0000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788863770.635156:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788863770.635160:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863770.635165:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788863770.635179:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff89e680ddb380) has no exports 00000020:00000080:0.0:1788863770.635198:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863770.635202:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788863770.635206:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6898e 00000020:00000080:0.0:1788863770.635210:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e680de4000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788863770.635218:0:15272:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e648f4b800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788863770.635222:0:15272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e648f4b800 2 00000020:01000004:0.0:1788863770.635225:0:15272:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e648f4b800 from lustre-MDT0001 00000020:00000080:0.0:1788863770.635269:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863770.635273:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788863770.635275:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e675708800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788863770.635277:0:15272:0:(genops.c:844:class_export_destroy()) destroying export ffff89e675708800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788863770.635284:0:15272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788863770.635310:0:15272:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788863770.635313:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788863770.635316:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863770.635319:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788863770.635327:0:15272:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff89e67ad59800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863770.635331:0:15272:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff89e680dd8000) has exports, disconnecting them 00000020:00000080:1.0:1788863770.635436:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de0000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788863770.635441:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e675709000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788863770.635443:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e675709000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788863770.635447:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788863770.635821:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:0.0:1788863770.635859:0:15272:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff89e67ad59800), last request at 1788863516 00000020:00000080:0.0:1788863770.635864:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b689e2 00000020:00080000:0.0:1788863770.635876:0:15272:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e67ad59800): rc 0 00000020:00000080:0.0:1788863770.635880:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e67ad59800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788863770.639799:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67ad59800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788863770.640484:0:15272:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788863770.640489:0:15272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863770.640495:0:15272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788863770.640501:0:15272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863770.640537:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e680de3800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788863770.640941:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863770.640950:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788863770.640955:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e680de2800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788863770.640967:0:15272:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788863770.640972:0:15272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788863770.641431:0:15272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e648f4b800 1 00000020:00000080:1.0:1788863770.641440:0:15272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6891e 00000020:00000080:1.0:1788863770.641448:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e680c21800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788863770.641464:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788863770.641473:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680c21800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788863770.641488:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863770.641494:0:15272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788863770.641498:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff89e658628000) has no exports 00000020:00000080:3.0:1788863770.692957:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863770.692970:0:15272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788863770.692975:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e676341800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788863770.692980:0:15272:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676341800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788863770.692991:0:15272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788863770.695110:0:15272:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e648f4b000 00000020:01000000:2.0:1788863770.695143:0:15272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788863770.695149:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863770.695155:0:15272:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788863770.695159:0:15272:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff89e65862b380) has no exports 00000100:00100000:2.0:1788863770.695292:0:6538:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff89e67214f000:6538] 2 exiting: rc = 0 00000100:00100000:0.0:1788863770.695696:0:12972:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff89e542859c00:12972] 4 exiting: rc = 0 00000100:00100000:0.0:1788863770.695826:0:6537:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff89e67214fe00:6537] 1 exiting: rc = 0 00000100:00100000:2.0:1788863770.696157:0:10368:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff89e5438da000:10368] 3 exiting: rc = 0 00000100:00100000:0.0:1788863770.697394:0:6536:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff89e67214ee00:6536] 0 exiting: rc = 1 00000100:00100000:2.0:1788863770.697729:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697744:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697753:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697764:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697773:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697784:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697794:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697817:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697827:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697839:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697850:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697860:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697869:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697879:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697887:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697892:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697897:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697902:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697908:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697913:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697918:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697925:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697931:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697937:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697943:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697949:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697958:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697969:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697981:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.697993:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698005:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698013:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698020:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698039:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698049:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698057:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698415:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698436:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698443:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698450:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698456:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698462:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698468:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698474:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698480:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698485:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698490:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698495:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698500:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698506:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698511:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698516:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698521:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698527:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698532:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698538:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698544:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698550:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698556:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698563:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698568:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698574:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698580:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.698593:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863770.703574:0:6539:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff89e67214f200:6539] 0 exiting: rc = 1 00000100:00100000:3.0:1788863770.703691:0:6540:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff89e67214fc00:6540] 1 exiting: rc = 0 00000100:00100000:2.0:1788863770.703799:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703821:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703830:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703838:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703864:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703870:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703876:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703882:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703888:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703895:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703900:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703907:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703914:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703920:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703925:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703929:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703934:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703940:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703946:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703952:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703957:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703963:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703969:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703974:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703979:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703984:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703990:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.703995:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704001:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704006:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704011:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704016:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704022:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704027:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704032:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704038:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704044:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704049:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704054:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704067:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704072:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704107:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704113:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704118:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704123:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704128:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704133:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704138:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704144:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704149:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704154:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704158:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704163:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704168:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704173:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704178:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704183:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704188:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704193:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704199:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704203:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704209:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704215:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704220:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.704661:0:6541:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff89e6587fe600:6541] 0 exiting: rc = 1 00000100:00100000:3.0:1788863770.705740:0:9795:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff89e54361a400:9795] 2 exiting: rc = 0 00000100:00100000:3.0:1788863770.705853:0:6542:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff89e6587ff200:6542] 1 exiting: rc = 0 00000100:00100000:2.0:1788863770.705926:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705936:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705944:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705950:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705973:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705980:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705986:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705991:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.705998:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706013:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706019:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706025:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706030:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706035:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706041:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706047:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706065:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706072:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706098:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706105:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706110:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706117:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706123:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706129:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706135:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706149:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706159:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706165:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706186:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706193:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706200:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706206:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706212:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706218:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706223:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706230:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706237:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706243:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706258:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706265:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706297:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706304:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706311:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706318:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706332:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706346:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706353:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706360:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706365:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706372:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706377:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706383:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706403:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706410:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706415:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706426:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706432:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706438:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706444:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706449:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706455:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706465:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706471:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.706477:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863770.713287:0:6543:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff89e6587fea00:6543] 0 exiting: rc = 1 00000100:00100000:0.0:1788863770.713329:0:6544:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89e67132a200:6544] 1 exiting: rc = 0 00000100:00100000:2.0:1788863770.713606:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713614:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713620:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713625:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713630:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713635:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713641:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713645:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713650:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713655:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713661:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713666:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713672:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713677:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713682:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713702:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713706:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713712:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713717:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713721:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713727:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713731:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713736:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713742:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713748:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713753:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713759:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713764:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713770:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713775:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713780:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713784:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713790:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713795:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713801:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713806:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713812:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713817:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713822:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713827:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713832:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713837:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713842:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713848:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713853:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713858:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713863:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713868:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713873:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713878:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713890:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713895:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713899:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713905:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713910:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713914:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713919:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713924:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713929:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713934:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713939:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713944:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713949:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.713954:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863770.714417:0:6546:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89e6720eda00:6546] 1 exiting: rc = 0 00000100:00100000:3.0:1788863770.714530:0:6545:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89e6720ec600:6545] 0 exiting: rc = 1 00000100:00100000:2.0:1788863770.714573:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714584:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714593:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714598:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714604:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714610:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714615:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714620:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714626:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714631:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714636:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714640:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714645:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714650:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714654:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714659:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714664:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714669:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714674:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714679:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714684:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714697:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714702:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714708:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714713:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714718:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714723:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714728:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714732:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714737:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714743:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714748:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714753:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714757:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714763:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714768:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714774:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714779:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714784:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714790:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714795:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714800:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714806:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714811:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714816:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714822:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714827:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714833:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714838:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714842:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714848:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714853:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714858:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714863:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714868:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714873:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714887:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714892:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714897:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714902:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714907:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714912:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714917:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.714922:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863770.715543:0:6548:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff89e6720eca00:6548] 1 exiting: rc = 0 00000100:00100000:3.0:1788863770.715640:0:6547:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff89e6720ed200:6547] 0 exiting: rc = 1 00000100:00100000:2.0:1788863770.715670:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715680:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715687:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715693:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715698:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715704:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715709:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715714:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715720:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715732:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715738:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715743:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715749:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715755:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715761:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715767:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715773:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715778:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715784:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715789:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715795:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715801:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715807:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715813:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715818:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715824:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715830:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715846:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715852:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715858:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715864:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715870:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715875:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715881:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715888:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715893:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715899:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715904:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715911:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715918:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715923:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715928:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715933:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715938:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715943:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715948:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715954:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715959:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715964:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715968:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715974:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715979:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715983:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715989:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715994:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.715999:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716003:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716008:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716014:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716018:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716023:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716027:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716040:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.716045:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863770.716811:0:6551:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff89e65e452a00:6551] 2 exiting: rc = 0 00000100:00100000:3.0:1788863770.716829:0:6549:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff89e671b28a00:6549] 0 exiting: rc = 1 00000100:00100000:1.0:1788863770.718961:0:6550:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff89e671b29000:6550] 1 exiting: rc = 0 00000100:00100000:2.0:1788863770.719382:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719389:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719393:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719398:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719403:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719408:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719421:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719443:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719451:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719457:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719463:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719469:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719473:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719480:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719485:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719490:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719496:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719501:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719506:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719512:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719517:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719522:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719527:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719534:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719539:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719545:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719551:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719557:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719563:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719569:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719575:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719595:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719602:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719620:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719664:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719672:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719677:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719682:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719688:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719693:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719698:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719704:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719710:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719715:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719721:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719726:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719732:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719738:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719743:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719749:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719754:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719759:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719763:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719768:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719772:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719792:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719799:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719804:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719810:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719815:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719821:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.719827:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.720292:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863770.720300:0:15272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788863770.725625:0:15272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863770.725639:0:15272:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788863770.725645:0:15272:0:(genops.c:885:class_export_put()) final put ffff89e65d9d0000/MDS_uuid 00000020:00000080:0.0:1788863770.725649:0:15272:0:(genops.c:844:class_export_destroy()) destroying export ffff89e65d9d0000/MDS_uuid for MDS 00000020:01000000:0.0:1788863770.725660:0:15272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788863770.725860:0:15272:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788863770.795423:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863771.116428:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863771.116440:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863771.116444:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863771.116448:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863771.116452:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5425cf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863771.116460:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1788863771.116466:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863771.116480:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425cf800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863771.116532:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b9f80 x1875759226591744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863771.116574:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863771.116577:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863771.116579:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863771.116583:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1788863771.116599:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863771.116605:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e543427800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863771.116618:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b8000 x1875759226592000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863771.117002:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226591744:0@lo:38:kworker.0 00000400:00000100:1.0:1788863771.117053:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226591744 offset 0 length 520: 4 00000100:00100000:2.0:1788863771.117538:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226591872:0@lo:400:kworker.0 00000400:00000100:2.0:1788863771.117566:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226591872 offset 0 length 224: 4 00000100:00100000:0.0:1788863771.117942:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226592128:0@lo:400:kworker.0 00000400:00000100:0.0:1788863771.117969:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226592128 offset 0 length 224: 4 00000100:00100000:1.0:1788863771.118044:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226592000:0@lo:38:kworker.0 00000400:00000100:1.0:1788863771.118066:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226592000 offset 0 length 520: 4 00010000:00010000:1.0:1788863771.820285:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863772.843625:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863773.872040:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788863774.397052:0:15473:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788863774.405633:0:15473:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788863774.405687:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863774.405702:0:15473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863774.405709:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863774.405730:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863774.405803:0:15473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788863774.405809:0:15473:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788863774.405832:0:15473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863774.405843:0:15473:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e66d4b9f80 x1875759226591744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863786 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863774.405864:0:15473:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788863774.405870:0:15473:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788863774.405876:0:15473:0:(import.c:65:import_set_state_nolock()) ffff89e5425cf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788863774.405881:0:15473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863774.405884:0:15473:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e66d4b9f80 x1875759226591744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863786 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863774.405891:0:15473:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788863774.405893:0:15473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1788863774.405937:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226591744:0@lo:38:kworker.0 00010000:00010000:1.0:1788863774.406137:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863774.406145:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406154:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167dc00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863774.406158:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406167:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863774.406185:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863774.406191:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788863774.406193:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788863774.406196:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788863774.406208:0:9549:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:1.0:1788863774.406211:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406224:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167dc00/0xf569beb9d4b68d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d62 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406248:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863774.406250:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863774.406252:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788863774.407005:0:15473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788863774.407013:0:15473:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e66d4ba300 x1875759226591872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863787 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863774.407031:0:15473:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788863774.407035:0:15473:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788863774.407057:0:15473:0:(import.c:65:import_set_state_nolock()) ffff89e541e73000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788863774.407098:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226591872:0@lo:400:kworker.0 00000100:00100000:1.0:1788863774.407251:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226592256:0@lo:39:umount.0 00000400:00000100:1.0:1788863774.407296:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226592256 offset 0 length 224: 4 00010000:00010000:0.0:1788863774.894556:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863775.147632:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863775.147641:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863775.147646:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863775.147650:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863775.147732:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226592384:0@lo:400:kworker.0 00000400:00000100:1.0:1788863775.147783:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226592384 offset 0 length 224: 4 00000001:00100000:1.0:1788863775.728341:0:8444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863775.728350:0:8444:0:(genops.c:885:class_export_put()) final put ffff89e5425b6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788863775.728958:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788863775.729021:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425b2000 for lustre-OST0000 00000001:00100000:3.0:1788863775.731628:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788863775.731637:0:9530:0:(genops.c:885:class_export_put()) final put ffff89e54343a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863775.731870:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e54343a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788863775.731979:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e54343d800 for lustre-OST0001 00010000:00010000:3.0:1788863775.915298:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863776.171245:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863776.171256:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863776.171260:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863776.171264:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788863776.171419:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863776.171444:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226592512:0@lo:400:kworker.0 00000400:00000100:2.0:1788863776.171501:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226592512 offset 0 length 224: 4 00010000:00010000:1.0:1788863776.939834:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863777.963551:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863778.987267:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863780.013009:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863780.587228:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863770/real 1788863770] req@ffff89e66d4bbb80 x1875759226591616/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788863780 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863780.587265:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e66d4bbb80 x1875759226591616/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788863780 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863780.587286:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e646758800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863780.587317:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788863780.587321:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3639:1875759226591616:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788863780.587700:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863780.587706:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788863780.587709:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e646758800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863780.587714:0:38:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788863780.587749:0:38:0:(import.c:630:import_select_connection()) MGC192.168.204.135@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788863780.587766:0:38:0:(import.c:666:import_select_connection()) MGC192.168.204.135@tcp: import ffff89e646758800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863780.587812:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dc380 x1875759226592640/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863780.587841:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863780.587846:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788863780.587942:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863780.587960:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226592768:0@lo:400:kworker.0 00000400:00000100:3.0:1788863780.588015:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226592768 offset 0 length 224: 4 00000100:00100000:1.0:1788863780.588182:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3639:1875759226592640:0@lo:250:kworker.0 00000400:00000100:1.0:1788863780.588217:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875759226592640 offset 0 length 520: 4 00010000:00010000:0.0:1788863781.037716:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863782.059234:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863783.083299:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863784.108197:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863784.683233:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863774/real 1788863774] req@ffff89e5440c3100 x1875759226592256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863784 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863784.683279:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5440c3100 x1875759226592256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863784 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863784.683300:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e541e73000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788863784.683321:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226592256:0@lo:39:umount.0 00000100:00080000:3.0:1788863784.683416:0:15473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788863784.683421:0:15473:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788863784.683427:0:15473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788863784.684320:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684334:0:15473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684341:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684348:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684378:0:15473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863784.684387:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684394:0:15473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684399:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684404:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863784.684440:0:15473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788863784.684445:0:15473:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788863784.684469:0:15473:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788863784.684474:0:15473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788863784.684478:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863784.684483:0:15473:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788863784.684488:0:15473:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff89e6763c4d40) has no exports 00000020:00080000:3.0:1788863784.684509:0:15473:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff89e6763c4d40) has no exports 00010000:00010000:0.0:1788863784.688881:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863784.688897:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.688909:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863784.688913:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.688923:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863784.688932:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863784.688937:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863784.688940:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788863784.688944:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788863784.688961:0:6526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:0.0:1788863784.688964:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.689002:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98000/0xf569beb9d4b68d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.689018:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863784.689022:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.689028:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031c00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863784.689031:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.689038:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863784.689045:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863784.689050:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788863784.689053:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788863784.689055:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788863784.689062:0:6526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:0.0:1788863784.689065:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.689071:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640031c00/0xf569beb9d4b68fdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68fe6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863784.689138:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863784.689140:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863784.689147:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863784.689251:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788863784.698795:0:15473:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e543565360 - data ffff89e671f14a20/ffff89e543917c00 00000020:01000000:3.0:1788863784.698943:0:15473:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e65d4e0f60 - data ffff89e671d99948/ffff89e541ed8800 00100000:10000000:3.0:1788863784.722323:0:15473:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788863784.743564:0:15473:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68abb 00000020:00000080:3.0:1788863784.743576:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e541f54000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788863784.743597:0:15473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67afa4000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788863784.743601:0:15473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67afa4000 2 00000020:01000004:3.0:1788863784.743604:0:15473:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e67afa4000 from lustre-OST0000 00000020:00000080:3.0:1788863784.743664:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863784.743674:0:15473:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788863784.743677:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e681bbb000/lustre-OST0000_UUID 00000020:00000080:3.0:1788863784.743680:0:15473:0:(genops.c:844:class_export_destroy()) destroying export ffff89e681bbb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788863784.743687:0:15473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788863784.743743:0:15473:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788863784.743747:0:15473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788863784.743750:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863784.743755:0:15473:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788863784.743761:0:15473:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89e5425cd000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863784.743766:0:15473:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff89e67613b380) has exports, disconnecting them 00000020:00080000:3.0:1788863784.743771:0:15473:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89e5425cd000), last request at 1788863537 00000020:00000080:3.0:1788863784.743785:0:15473:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68ae5 00000020:00080000:3.0:1788863784.743794:0:15473:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5425cd000): rc 0 00000020:00000080:3.0:1788863784.743798:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e5425cd000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788863784.744479:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541f54000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788863784.744491:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425cd000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788863784.749092:0:15473:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788863784.749100:0:15473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863784.749104:0:15473:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788863784.749112:0:15473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863784.749342:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425cf800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788863784.749346:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863784.749354:0:15473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788863784.749359:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e5425cd800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788863784.749362:0:15473:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425cd800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788863784.749369:0:15473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788863784.749518:0:15473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788863784.749523:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863784.749529:0:15473:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788863784.749535:0:15473:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff89e541e72800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788863784.749541:0:15473:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff89e680dd99c0) has exports, disconnecting them 00000020:00080000:1.0:1788863784.749546:0:15473:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff89e541e72800), last request at 1788863537 00000020:00000080:1.0:1788863784.749550:0:15473:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68afa 00000020:00080000:1.0:1788863784.749563:0:15473:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e541e72800): rc 0 00000020:00000080:1.0:1788863784.749568:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e541e72800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788863784.750276:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541e72800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788863784.781336:0:15473:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788863784.781345:0:15473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788863784.781350:0:15473:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788863784.781360:0:15473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788863784.781402:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e541e73000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788863784.781583:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863784.781592:0:15473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788863784.781597:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e541e74000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788863784.781601:0:15473:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541e74000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788863784.781609:0:15473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788863784.781698:0:15473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67afa4000 1 00000020:00000080:2.0:1788863784.781704:0:15473:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68a83 00000020:00000080:2.0:1788863784.781710:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e67ad5d000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788863784.781718:0:15473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788863784.781725:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67ad5d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788863784.781734:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863784.781739:0:15473:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788863784.781743:0:15473:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff89e67613cd40) has no exports 00000020:00000080:2.0:1788863784.982405:0:15473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863784.982420:0:15473:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788863784.982426:0:15473:0:(genops.c:885:class_export_put()) final put ffff89e67afa2800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788863784.982431:0:15473:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67afa2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788863784.982440:0:15473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788863784.982573:0:15473:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e67afa3000 00000020:02000400:2.0:1788863784.982618:0:15473:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788863785.136498:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863785.967430:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863785.967440:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863785.967443:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863785.967446:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863785.967519:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226592896:0@lo:400:kworker.0 00000400:00000100:1.0:1788863785.967587:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226592896 offset 0 length 224: 4 00010000:00010000:0.0:1788863786.155250:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863786.740966:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863771/real 1788863771] req@ffff89e66d4b8000 x1875759226592000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788863786 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863786.740999:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e66d4b8000 x1875759226592000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788863786 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788863786.742675:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863786.742697:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788863786.742704:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226592000:0@lo:38:kworker.0 00000100:00080000:0.0:1788863786.742732:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863786.742737:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863786.742739:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863786.742742:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788863786.742744:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863786.742748:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1788863786.742753:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788863786.742764:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e543427800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863786.742793:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dea00 x1875759226593024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863786.742836:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226593024:0@lo:38:kworker.0 00000400:00000100:0.0:1788863786.742883:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226593024 offset 0 length 520: 4 00010000:00010000:1.0:1788863787.180589:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788863788.024225:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863771/real 1788863771] req@ffff89e66d4bad80 x1875759226592128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863788.104465:0:3642:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89e66d4bad80 x1875759226592128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863788.104480:0:3642:0:(import.c:65:import_set_state_nolock()) ffff89e54343e800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788863788.104484:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788863788.147982:0:3642:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788863788.148267:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863788.148274:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863788.148277:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863788.148280:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863788.148283:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863788.148294:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788863788.148297:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e54343e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863788.148305:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 229 00000100:00080000:0.0:1788863788.148320:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89e54343e800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863788.148368:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438ddf80 x1875759226593152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863788.148418:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226592128:0@lo:400:kworker.0 00000100:00100000:1.0:1788863788.148496:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226593152:0@lo:38:kworker.0 00000400:00000100:1.0:1788863788.148542:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226593152 offset 0 length 520: 4 00010000:00010000:3.0:1788863788.216821:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863789.228072:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788863789.518702:0:15675:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788863789.538226:0:15675:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788863789.538330:0:15675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863789.538345:0:15675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863789.538352:0:15675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863789.538358:0:15675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863789.538379:0:15675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788863789.538385:0:15675:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788863789.538424:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863789.538436:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dea00 x1875759226593024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863806 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863789.538458:0:15675:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788863789.538465:0:15675:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788863789.538472:0:15675:0:(import.c:65:import_set_state_nolock()) ffff89e543427800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788863789.538477:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863789.538481:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dea00 x1875759226593024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863806 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863789.538489:0:15675:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788863789.538492:0:15675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:3.0:1788863789.538607:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863789.538616:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.538623:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650114400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863789.538627:0:9549:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.538636:0:9549:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863789.538642:0:9549:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863789.538648:0:9549:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863789.538650:0:9549:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788863789.538652:0:9549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788863789.538665:0:9549:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:3.0:1788863789.538669:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.538686:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114400/0xf569beb9d4b68d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d46 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.538697:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863789.538699:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863789.538700:0:9549:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863789.538934:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226593024:0@lo:38:kworker.0 00000100:00080000:1.0:1788863789.546698:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788863789.546720:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438de300 x1875759226592384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863791 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.546789:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dd500 x1875759226592512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863792 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.546843:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438ded80 x1875759226592768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863796 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.546892:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e66d4bbb80 x1875759226592896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863801 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.546904:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438ddf80 x1875759226593152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863798 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.546914:0:15675:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788863789.546920:0:15675:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788863789.546926:0:15675:0:(import.c:65:import_set_state_nolock()) ffff89e54343e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788863789.546949:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788863789.546953:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438de300 x1875759226592384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863791 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863789.547015:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226592768:0@lo:400:kworker.0 00000100:00100000:2.0:1788863789.547053:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226592512:0@lo:400:kworker.0 00000100:00100000:3.0:1788863789.547109:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226592384:0@lo:400:kworker.0 00000100:00100000:1.0:1788863789.547197:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dd500 x1875759226592512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863792 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.547207:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438ded80 x1875759226592768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863796 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.547215:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e66d4bbb80 x1875759226592896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863801 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.547224:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438ddf80 x1875759226593152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863798 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863789.547231:0:15675:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788863789.547314:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226592896:0@lo:400:kworker.0 00000100:00100000:0.0:1788863789.547342:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226593152:0@lo:38:kworker.0 00000100:00100000:1.0:1788863789.547655:0:15675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788863789.553415:0:15675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863789.553440:0:15675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863789.553448:0:15675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863789.553456:0:15675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863789.553771:0:15675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863789.553782:0:15675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863789.553811:0:15675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863789.553818:0:15675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863789.553824:0:15675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.553916:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863789.553925:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.553933:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863789.553938:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.553948:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863789.553956:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863789.553962:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863789.553965:0:6525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788863789.553991:0:6525:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:3.0:1788863789.553995:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.554002:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b68d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68d54 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.554027:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863789.554030:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.554036:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d90000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863789.554039:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.554046:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863789.554052:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863789.554056:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788863789.554059:0:6525:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788863789.554064:0:6525:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:3.0:1788863789.554067:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863789.554103:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863789.554105:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863789.554108:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863789.554489:0:15675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788863789.554495:0:15675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d90000/0xf569beb9d4b68fd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68fd8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863789.554513:0:15675:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788863789.554522:0:15675:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788863789.554525:0:15675:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788863789.554574:0:15675:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788863789.554578:0:15675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788863789.554586:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863789.554592:0:15675:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788863789.554597:0:15675:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff89e5428e8000) has no exports 00000020:00080000:1.0:1788863789.554624:0:15675:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff89e5428e8000) has no exports 00000020:01000000:1.0:1788863789.565272:0:15675:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e5437a1c00 - data ffff89e671f226c0/ffff89e54394c400 00010000:00010000:0.0:1788863789.565971:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788863789.566773:0:15675:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e5437a1b40 - data ffff89e671f2b798/ffff89e543892000 00100000:10000000:0.0:1788863789.578804:0:15675:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788863789.584489:0:15675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68be1 00000020:00000080:0.0:1788863789.584502:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e543421800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788863789.586119:0:15675:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67aeee000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788863789.586127:0:15675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67aeee000 2 00000020:01000004:0.0:1788863789.586130:0:15675:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e67aeee000 from lustre-OST0001 00000020:00000080:0.0:1788863789.586163:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863789.586175:0:15675:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788863789.586179:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e543420000/lustre-OST0001_UUID 00000020:00000080:0.0:1788863789.586183:0:15675:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543420000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788863789.586191:0:15675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788863789.586373:0:15675:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc->MGS 00010000:00010000:0.0:1788863789.586391:0:15675:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030c00/0xf569beb9d4b6893a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68941 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863789.586405:0:15675:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030c00/0xf569beb9d4b6893a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68941 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863789.586412:0:15675:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788863789.586415:0:15675:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788863789.586418:0:15675:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788863789.586433:0:15675:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:0.0:1788863789.586436:0:15675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030c00/0xf569beb9d4b6893a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68941 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863789.586454:0:15675:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b68db6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863789.586461:0:15675:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b68db6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863789.586467:0:15675:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863789.586469:0:15675:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788863789.586471:0:15675:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788863789.586480:0:15675:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e646758800 00010000:00010000:0.0:1788863789.586483:0:15675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650114e00/0xf569beb9d4b68daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b68db6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788863789.586501:0:15675:0:(import.c:65:import_set_state_nolock()) ffff89e646758800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788863789.586505:0:15675:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788863789.586507:0:15675:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788863789.586509:0:15675:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788863789.587294:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788863789.587365:0:15675:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dc380 x1875759226592640/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788863795 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788863789.587394:0:15675:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788863789.587397:0:15675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1788863789.587447:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9205f27e-a2bf-4f82-a9c9-67d4609e8ffc:3639:1875759226592640:0@lo:250:kworker.0 10000000:01000000:0.0:1788863789.587949:0:15675:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788863789.587958:0:15675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68837 00000020:00000080:0.0:1788863789.587966:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e65d9d4000/9205f27e-a2bf-4f82-a9c9-67d4609e8ffc 00000020:00000080:3.0:1788863789.589433:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543421800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788863789.590263:0:15675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.135@tcp (flags='') 00000020:00000080:0.0:1788863789.590272:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863789.590281:0:15675:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.135@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788863789.590286:0:15675:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff89e671354d40) has no exports 00000020:00000080:3.0:1788863789.590385:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e65d9d4000/9205f27e-a2bf-4f82-a9c9-67d4609e8ffc for MGC192.168.204.135@tcp 10000000:01000000:2.0:1788863789.591430:0:6534:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788863789.591608:0:15675:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.135@tcp: client import never connected 00000100:00080000:0.0:1788863789.591613:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788863789.591616:0:15675:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788863789.591620:0:15675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788863789.591623:0:15675:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788863789.591695:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863789.591703:0:15675:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.135@tcp (uuid 9205f27e-a2bf-4f82-a9c9-67d4609e8ffc) 00000020:01000000:0.0:1788863789.591712:0:15675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788863789.591717:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863789.591721:0:15675:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788863789.591728:0:15675:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff89e543425000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863789.591734:0:15675:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff89e5428e99c0) has exports, disconnecting them 00000020:00080000:0.0:1788863789.591740:0:15675:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff89e543425000), last request at 1788863562 00000020:00000080:0.0:1788863789.591746:0:15675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68c0b 00000020:00080000:0.0:1788863789.591778:0:15675:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e543425000): rc 0 00000020:00000080:0.0:1788863789.591783:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e543425000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788863789.592757:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e646758800 for MGC192.168.204.135@tcp 00000020:00000080:3.0:1788863789.592777:0:38:0:(genops.c:885:class_export_put()) final put ffff89e64675b000/9205f27e-a2bf-4f82-a9c9-67d4609e8ffc 00000020:00000080:3.0:1788863789.592781:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e64675b000/9205f27e-a2bf-4f82-a9c9-67d4609e8ffc for MGC192.168.204.135@tcp 00000020:01000000:3.0:1788863789.592798:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.135@tcp (9205f27e-a2bf-4f82-a9c9-67d4609e8ffc) 00000020:00000080:3.0:1788863789.593105:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543425000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788863789.593267:0:15675:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788863789.593271:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863789.593275:0:15675:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788863789.593280:0:15675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788863789.593449:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863789.593456:0:15675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788863789.593460:0:15675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788863789.593478:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863789.593481:0:15675:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788863789.593487:0:15675:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff89e54343e000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788863789.593491:0:15675:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff89e6763c0000) has exports, disconnecting them 00000020:00080000:2.0:1788863789.593495:0:15675:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff89e54343e000), last request at 1788863562 00000020:00000080:2.0:1788863789.593499:0:15675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68c20 00000020:00080000:2.0:1788863789.593527:0:15675:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e54343e000): rc 0 00000020:00000080:2.0:1788863789.593532:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e54343e000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788863789.594376:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543427800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788863789.594383:0:38:0:(genops.c:885:class_export_put()) final put ffff89e543424000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788863789.594386:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543424000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788863789.594391:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788863789.594440:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e54343e000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788863789.594462:0:15675:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788863789.594465:0:15675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788863789.594468:0:15675:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788863789.594472:0:15675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863789.594490:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e54343e800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788863789.594533:0:9549:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788863789.594629:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788863789.665127:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788863789.665358:0:6521:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff89e67561fc00:6521] 1 exiting: rc = 0 00000100:00100000:0.0:1788863789.668984:0:6520:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff89e67561f600:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1788863789.669462:0:7487:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_002: service thread [ffff89e65d596600:7487] 2 exiting: rc = 0 00000100:00100000:3.0:1788863789.669958:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.670311:0:10355:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff89e543940400:10355] 3 exiting: rc = 0 00000100:00100000:3.0:1788863789.670398:0:10356:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_004: service thread [ffff89e67ae2f000:10356] 4 exiting: rc = 0 00000100:00100000:0.0:1788863789.677622:0:6524:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff89e65983f200:6524] 2 exiting: rc = 0 00000100:00100000:1.0:1788863789.688367:0:6523:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff89e6494e9a00:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1788863789.688529:0:6522:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff89e65983e200:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1788863789.688631:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688641:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688648:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688656:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688662:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688667:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688674:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688680:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688686:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688691:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688697:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688716:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688721:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688728:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688734:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688739:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688744:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688751:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688758:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688779:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688787:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688792:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688798:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688805:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688812:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688818:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688825:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688831:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688836:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688842:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688846:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688851:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688856:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688861:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688866:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688871:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688889:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688894:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688900:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688905:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688911:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688917:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688921:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688927:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688933:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688938:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688952:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688957:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688962:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688967:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688972:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688978:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688983:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688988:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688993:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.688998:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689003:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689009:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689013:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689018:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689022:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689027:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689032:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.689037:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788863789.690535:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863789.690546:0:15675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788863789.690555:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e54343a800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788863789.690559:0:15675:0:(genops.c:844:class_export_destroy()) destroying export ffff89e54343a800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788863789.690565:0:15675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788863789.690615:0:15675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67aeee000 1 00000020:00000080:3.0:1788863789.690622:0:15675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b68bb0 00000020:00000080:3.0:1788863789.690628:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e655c61000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788863789.690639:0:15675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788863789.690650:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c61000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788863789.690662:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863789.690667:0:15675:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788863789.690671:0:15675:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff89e5428eb380) has no exports 00000020:00000080:2.0:1788863789.878801:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863789.878814:0:15675:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788863789.878819:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e67aeef000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788863789.878824:0:15675:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67aeef000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788863789.878838:0:15675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788863789.879177:0:15675:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e67aeee800 00000020:01000000:2.0:1788863789.879199:0:15675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788863789.879203:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863789.879208:0:15675:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788863789.879212:0:15675:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff89e6586299c0) has no exports 00000020:00000080:2.0:1788863789.879231:0:15675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863789.879235:0:15675:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788863789.879238:0:15675:0:(genops.c:885:class_export_put()) final put ffff89e67ad58800/OSS_uuid 00000020:00000080:2.0:1788863789.879240:0:15675:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67ad58800/OSS_uuid for OSS 00000020:01000000:2.0:1788863789.879243:0:15675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788863789.879334:0:8451:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff89e67133f800:8451] 1 exiting: rc = 0 00000100:00100000:2.0:1788863789.879334:0:14490:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff89e650923200:14490] 4 exiting: rc = 0 00000100:00080000:0.0:1788863789.879433:0:6533:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788863789.879460:0:8450:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff89e676374c00:8450] 0 exiting: rc = 1 00000100:00100000:3.0:1788863789.880414:0:8606:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff89e681e26200:8606] 3 exiting: rc = 0 00000100:00100000:2.0:1788863789.881478:0:8452:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff89e67614f200:8452] 2 exiting: rc = 0 00000100:00100000:1.0:1788863789.881724:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881733:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881743:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881770:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881780:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881786:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881794:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881802:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881808:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881814:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881822:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881938:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881951:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881956:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881962:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881970:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881977:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881990:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.881996:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882001:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882007:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882012:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882017:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882024:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882029:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882038:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882047:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882053:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882058:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882066:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882095:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882102:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882108:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882114:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882119:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882124:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882130:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882139:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882155:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882161:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882169:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882177:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882182:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882188:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882198:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882205:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882209:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882218:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882227:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882232:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882238:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882246:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882254:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882259:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882265:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882273:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882281:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882287:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882292:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882297:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882304:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882309:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882314:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.882319:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863789.890234:0:8454:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89e67ad8ce00:8454] 1 exiting: rc = 0 00000100:00100000:3.0:1788863789.890906:0:8453:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89e67614f000:8453] 0 exiting: rc = 1 00000100:00100000:0.0:1788863789.890985:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.890995:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891003:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891008:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891014:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891019:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891024:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891030:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891035:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891040:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891046:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891051:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891056:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891061:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891065:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891071:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891100:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891106:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891111:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891116:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891121:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891126:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891130:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891134:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891139:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891144:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891148:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891153:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891158:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891163:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891168:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891174:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891178:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891183:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891188:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891208:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891213:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891219:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891224:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891229:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891235:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891241:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891247:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891252:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891257:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891262:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891280:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891287:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891292:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891303:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891308:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891313:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891319:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891324:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891329:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891335:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891340:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891346:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891351:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891357:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891361:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891366:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891372:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.891385:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.893125:0:8457:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89e67ace3e00:8457] 1 exiting: rc = 0 00000100:00100000:0.0:1788863789.893380:0:8458:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89e67ace3200:8458] 2 exiting: rc = 0 00000100:00100000:0.0:1788863789.894433:0:8456:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89e67ace2e00:8456] 0 exiting: rc = 1 00000100:00100000:0.0:1788863789.894855:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894865:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894884:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894890:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894913:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894919:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894924:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894930:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894945:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894952:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894957:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894962:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894968:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894974:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894979:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894985:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894991:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.894997:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895002:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895007:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895012:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895018:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895023:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895029:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895034:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895039:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895046:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895051:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895057:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895063:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895068:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895090:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895112:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895119:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895125:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895130:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895136:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895142:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895146:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895158:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895164:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895169:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895174:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895179:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895184:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895189:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895194:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895200:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895206:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895211:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895217:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895223:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895228:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895234:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895239:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895244:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895262:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895269:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895275:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895282:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895287:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895293:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895498:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863789.895569:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.913944:0:8459:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff89e67ace3400:8459] 0 exiting: rc = 1 00000100:00100000:3.0:1788863789.914232:0:8460:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff89e67ad8ec00:8460] 1 exiting: rc = 0 00000100:00100000:1.0:1788863789.914402:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914411:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914416:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914421:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914427:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914432:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914437:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914444:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914449:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914468:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914473:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914479:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914484:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914489:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914495:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914514:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914521:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914526:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914533:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914539:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914546:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914553:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914558:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914564:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914569:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914574:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914579:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914585:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914591:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914597:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914603:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914608:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914614:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914620:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914626:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914632:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914637:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914643:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914649:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914657:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914662:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914667:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914672:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914677:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914692:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914697:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914702:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914708:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914714:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914719:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914725:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914730:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914735:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914740:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914746:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914751:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914756:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914884:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914890:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914896:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914902:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914908:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914913:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.914920:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863789.915743:0:8461:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff89e67ad8f600:8461] 0 exiting: rc = 1 00000100:00100000:2.0:1788863789.918065:0:8462:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff89e67ad8e200:8462] 1 exiting: rc = 0 00000100:00100000:1.0:1788863789.918434:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918452:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918486:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918494:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918500:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918519:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918526:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918532:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918539:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918546:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918552:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918560:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918568:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918577:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918599:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918623:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918629:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918636:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918643:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918650:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918658:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918664:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918672:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918678:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918685:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918692:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918715:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918722:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918728:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918734:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918741:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918747:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918754:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918774:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918782:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918789:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918795:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918802:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918823:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918832:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918838:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918845:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918852:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918856:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918862:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918883:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918890:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918896:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918902:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918908:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918934:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918941:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918947:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918954:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918959:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918964:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918970:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918976:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918983:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918989:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.918995:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.919000:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.919006:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863789.919019:0:15675:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788863789.939543:0:15675:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788863812.323555:0:16439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788863822.934816:0:17039:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788863822.934821:0:17039:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788863822.934823:0:17039:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788863822.934937:0:17039:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e5448c2800 00000020:01000004:2.0:1788863822.934951:0:17039:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788863822.934958:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788863822.934974:0:17039:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89e5428eb380) 00000020:00000080:2.0:1788863822.934986:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788863823.027930:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.028513:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788863823.030203:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.030417:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.030705:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.031021:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.031400:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.031945:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.032414:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.032861:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.033066:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.033408:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.033723:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.034163:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.034415:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.034695:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.035009:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.035273:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.035479:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.035708:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.036024:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.036656:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.036970:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.037389:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.037662:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.037971:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.038206:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.038640:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.038899:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.039137:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.039391:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.039630:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.039893:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788863823.040122:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788863823.041061:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788863823.042524:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788863823.042828:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788863823.044504:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788863823.044855:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788863823.045363:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788863823.045620:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788863823.045931:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788863823.046334:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788863823.046591:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788863823.046935:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788863823.047137:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788863823.047412:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788863823.048963:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788863823.049857:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788863823.050190:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788863823.050694:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788863823.050987:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788863823.051309:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788863823.052468:0:17039:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788863823.052682:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788863823.052691:0:17039:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788863823.052704:0:17039:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69de6 00000020:01000004:3.0:1788863823.052711:0:17039:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788863823.052716:0:17039:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788863823.052721:0:17039:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e5448c2800 from MGS 00000020:01000004:3.0:1788863823.052725:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788863823.052735:0:17039:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89e543a1b380) 00000020:00000080:3.0:1788863823.052827:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788863823.052893:0:17039:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5448c2800 from MGS, refs=2 00080000:01000000:3.0:1788863823.052898:0:17039:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788863823.052903:0:17039:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69df4 00000100:00100000:3.0:1788863823.052999:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788863823.053306:0:17039:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788863823.053313:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788863823.053981:0:17039:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788863823.053988:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788863823.054922:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863823.055283:0:17039:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788863823.055294:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788863823.056503:0:17039:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788863823.056514:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788863823.057390:0:17039:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788863823.057464:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788863823.058254:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863823.058258:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863823.058260:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863823.058602:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863823.058605:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863823.058606:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863823.059129:0:17039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788863823.060643:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788863823.064231:0:17039:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788863823.067289:0:17051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788863823.071800:0:17039:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788863823.071864:0:17039:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788863823.072914:0:17039:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788863823.073283:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863823.073461:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788863823.073467:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788863823.074322:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788863823.074330:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788863823.074681:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788863823.074687:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788863823.075599:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788863823.075620:0:17039:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.135@tcp' 00000020:01000004:2.0:1788863823.075622:0:17039:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788863823.075666:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.135@tcp (typ=mgc) 00000020:00000080:2.0:1788863823.075678:0:17039:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.135@tcp (ffff89e5428e99c0) 00000020:00000080:2.0:1788863823.075693:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788863823.075774:0:17039:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e5448c5800@MGC192.168.204.135@tcp: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863823.075921:0:17039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.135@tcp-0 is initialized 00000040:01000000:2.0:1788863823.075927:0:17039:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788863823.076283:0:17056:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788863823.078681:0:17058:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788863823.078769:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.135@tcp (uuid dea3065e-0e63-4370-a87c-9d4f07265d5e) 00000020:00000080:3.0:1788863823.078797:0:17039:0:(genops.c:1384:class_connect()) connect: client dea3065e-0e63-4370-a87c-9d4f07265d5e, cookie 0xf569beb9d4b69e02 00000100:00080000:3.0:1788863823.078812:0:17039:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863823.078824:0:17039:0:(import.c:666:import_select_connection()) MGC192.168.204.135@tcp: import ffff89e5448c5800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863823.078863:0:17039:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5440c3480 x1875759226593280/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863823.078890:0:17039:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS 00000020:01000004:3.0:1788863823.078943:0:17039:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788863823.078948:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788863823.078962:0:17039:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff89e543a18000) 00000020:00000080:3.0:1788863823.078973:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788863823.080609:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dea3065e-0e63-4370-a87c-9d4f07265d5e:3639:1875759226593280:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788863823.080691:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863823.081138:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226593280 00000100:00100000:3.0:1788863823.081148:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226593280 00000100:00100000:3.0:1788863823.081191:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863823.081199:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3639:x1875759226593280:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788863823.081236:0:17054:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from dea3065e-0e63-4370-a87c-9d4f07265d5e@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1788863823.081263:0:17054:0:(genops.c:1384:class_connect()) connect: client dea3065e-0e63-4370-a87c-9d4f07265d5e, cookie 0xf569beb9d4b69e10 00000100:00080000:3.0:1788863823.081661:0:17054:0:(import.c:65:import_set_state_nolock()) ffff89e67f896000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863823.081753:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+5:3639:x1875759226593280:12345-0@lo:250:mount.lustre.0 Request processed in 552us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863823.081762:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863823.081816:0:3639:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788863823.081826:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:3.0:1788863823.081834:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788863823.081839:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788863823.081841:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5448c5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788863823.081844:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788863823.081905:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788863823.081912:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dea3065e-0e63-4370-a87c-9d4f07265d5e:3639:1875759226593280:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788863823.090609:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863823.090914:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788863823.090921:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788863823.091880:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788863823.091890:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788863823.092390:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788863823.092397:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788863823.093748:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863823.094233:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788863823.094241:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788863823.095016:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788863823.095025:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788863823.152619:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863823.152836:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788863823.152843:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788863823.153907:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788863823.153917:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788863823.154595:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863823.154984:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788863823.154989:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788863823.155642:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788863823.155650:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788863823.156204:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863823.156364:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788863823.156370:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788863823.156842:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788863823.156849:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788863823.157477:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863823.157616:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788863823.157620:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788863823.158038:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788863823.158045:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788863823.178456:0:17039:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863823.178664:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788863823.178671:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788863823.180479:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788863823.180564:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788863823.181520:0:17039:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788863823.181530:0:17039:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788863823.182420:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788863823.182446:0:17039:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788863823.182452:0:17039:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788863823.182549:0:17039:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788863823.182580:0:17039:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788863823.182584:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788863823.182586:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788863823.182587:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863823.182589:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863823.182590:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863823.182591:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863823.182593:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788863823.182594:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788863823.182596:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863823.182597:0:17039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788863823.182599:0:17039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788863823.182601:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788863823.182602:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788863823.182603:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863823.182604:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863823.182605:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863823.182606:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863823.182607:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788863823.182608:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788863823.182609:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863823.182610:0:17039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788863823.182643:0:17039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788863823.182660:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593408:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788863823.182719:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.182775:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a92300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863823.182842:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226593408 00000100:00100000:0.0:1788863823.182850:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226593408 00000100:00100000:0.0:1788863823.182890:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863823.182898:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+5:17039:x1875759226593408:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863823.182939:0:17055:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788863823.182942:0:17055:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788863823.182945:0:17055:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788863823.183311:0:17076:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788863823.183782:0:17055:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788863823.186499:0:17077:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788863823.186508:0:17077:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788863823.186511:0:17077:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788863823.186513:0:17077:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788863823.186703:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788863823.187276:0:17055:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788863823.187287:0:17055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788863823.189384:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+5:17039:x1875759226593408:12345-0@lo:253:mount.lustre.0 Request processed in 6476us (6654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863823.189398:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863823.189494:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788863823.189511:0:17039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788863823.189524:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788863823.189526:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788863823.189527:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863823.189528:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863823.189530:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863823.189531:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863823.189532:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788863823.189534:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788863823.189536:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863823.189537:0:17039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788863823.189555:0:17039:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e5448c2800 from lustre-MDT0000 10000000:01000000:2.0:1788863823.189585:0:17039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788863823.189588:0:17039:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788863823.189592:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89e5428e99c0 10000000:01000000:2.0:1788863823.189596:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788863823.189603:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89e5428e99c0 from 1 10000000:01000000:2.0:1788863823.189606:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788863823.189646:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.189658:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.189668:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.189687:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788863823.189722:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863823.190039:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226593536 00000100:00100000:3.0:1788863823.190046:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226593536 00000100:00100000:2.0:1788863823.190183:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863823.190319:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863823.190338:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+5:17039:x1875759226593536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863823.190352:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863823.190366:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99200/0xf569beb9d4b69e1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69e17 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.190391:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99200/0xf569beb9d4b69e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69e17 expref: 6 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.190404:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99200/0xf569beb9d4b69e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69e17 expref: 6 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.190413:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99200, rc 0) 00000100:00100000:3.0:1788863823.190461:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+6:17039:x1875759226593536:12345-0@lo:101:mount.lustre.0 Request processed in 126us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863823.190468:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863823.190539:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863823.190552:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.190572:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.190629:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863823.190657:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.190745:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863823.191056:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226593664 00000100:00100000:0.0:1788863823.191062:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226593664 00000100:00100000:0.0:1788863823.191118:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788863823.191125:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+6:17039:x1875759226593664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863823.191206:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+6:17039:x1875759226593664:12345-0@lo:501:mount.lustre.0 Request processed in 81us (549us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863823.191224:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863823.191376:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593664:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788863823.191405:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788863823.191426:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191435:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863823.191444:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e5448c2800 10000000:01000000:2.0:1788863823.191450:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788863823.191455:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e5448c2800 10000000:01000000:2.0:1788863823.191458:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788863823.191461:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89e5448c2800 from 1 10000000:01000000:2.0:1788863823.191464:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788863823.191484:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191491:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191499:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.191524:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788863823.191551:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.191578:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226593792 00000100:00100000:2.0:1788863823.191582:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226593792 00000100:00100000:2.0:1788863823.191599:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863823.191605:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+6:17039:x1875759226593792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863823.191613:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863823.191623:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e641537c00/0xf569beb9d4b69e2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69e25 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191638:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e641537c00/0xf569beb9d4b69e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69e25 expref: 7 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191647:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e641537c00/0xf569beb9d4b69e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69e25 expref: 7 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191653:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537c00, rc 0) 00000100:00100000:2.0:1788863823.191675:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+7:17039:x1875759226593792:12345-0@lo:101:mount.lustre.0 Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.191693:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863823.191727:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.191740:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863823.191751:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191759:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863823.191777:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788863823.191781:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191788:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863823.191793:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788863823.191797:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788863823.191801:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e5448c2800 10000000:01000000:2.0:1788863823.191803:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788863823.191816:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788863823.191818:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788863823.191833:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191840:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191847:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.191859:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788863823.191885:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.191905:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226593920 00000100:00100000:2.0:1788863823.191909:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226593920 00000100:00100000:2.0:1788863823.191925:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863823.191931:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+7:17039:x1875759226593920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863823.191944:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863823.191952:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e641537a00/0xf569beb9d4b69e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69e33 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191968:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e641537a00/0xf569beb9d4b69e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69e33 expref: 8 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191976:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e641537a00/0xf569beb9d4b69e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69e33 expref: 8 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.191982:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641537a00, rc 0) 00000100:00100000:2.0:1788863823.192006:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+8:17039:x1875759226593920:12345-0@lo:101:mount.lustre.0 Request processed in 76us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.192012:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863823.192033:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.192044:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226593920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863823.192054:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.192061:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.192136:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226594048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863823.192159:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.192179:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226594048 00000100:00100000:2.0:1788863823.192183:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226594048 00000100:00100000:2.0:1788863823.192198:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863823.192203:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+8:17039:x1875759226594048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863823.192335:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17039:x1875759226594048:12345-0@lo:501:mount.lustre.0 Request processed in 131us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.192342:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863823.192362:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.192372:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226594048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863823.192409:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226594176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863823.192453:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.192472:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226594176 00000100:00100000:2.0:1788863823.192476:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226594176 00000100:00100000:2.0:1788863823.192491:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863823.192496:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17039:x1875759226594176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863823.192627:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.193483:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17039:x1875759226594176:12345-0@lo:503:mount.lustre.0 Request processed in 983us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.193493:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863823.193555:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226594176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863823.194431:0:17078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17078:1875759226594304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863823.195701:0:17078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863823.195756:0:17078:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649af5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.196293:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226594304 00000100:00100000:2.0:1788863823.196302:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226594304 00000100:00100000:2.0:1788863823.196356:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863823.196366:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17078:x1875759226594304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863823.197511:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17078:x1875759226594304:12345-0@lo:502:llog_process_th.0 Request processed in 1142us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.197523:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863823.197634:0:17078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17078:1875759226594304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863823.197670:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863823.197680:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863823.197683:0:17078:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788863823.197688:0:17078:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788863823.197691:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788863823.197706:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89e6586299c0) 00000020:00000080:0.0:1788863823.197721:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788863823.197728:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788863823.197822:0:17078:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788863823.197830:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69e48 00000020:00000080:0.0:1788863823.198020:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788863823.198025:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863823.198028:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863823.198029:0:17078:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788863823.198032:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863823.198035:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863823.198037:0:17078:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788863823.198040:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788863823.198046:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89e65862b380) 00000020:00000080:0.0:1788863823.198056:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788863823.198060:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788863823.198062:0:17078:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788863823.198065:0:17078:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788863823.198070:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788863823.198453:0:17078:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5448c2800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788863823.198468:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89e65862cd40) 00000020:00000080:0.0:1788863823.198477:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788863823.198530:0:17078:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788863823.198536:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b69e5d 00000020:00000080:0.0:1788863823.198633:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788863823.198639:0:17078:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788863823.198643:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf569beb9d4b69e64 00080000:01000000:0.0:1788863823.198648:0:17078:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788863823.198652:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69e6b 00010000:00010000:2.0:1788863823.278364:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788863823.278934:0:17078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788863823.280018:0:17078:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788863823.280848:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89e5428e8000) 00000020:00000080:2.0:1788863823.280869:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788863823.280953:0:17078:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788863823.280960:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69e79 00000020:00000080:2.0:1788863823.282036:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788863823.288043:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf569beb9d4b69e80 00000020:00000080:2.0:1788863823.288636:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788863823.288648:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863823.288655:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863823.288657:0:17078:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788863823.288660:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788863823.288663:0:17078:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788863823.288664:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788863823.288665:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788863823.288667:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788863823.288669:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863823.288671:0:17078:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788863823.288673:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863823.288678:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863823.288679:0:17078:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788863823.288683:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788863823.288717:0:17078:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788863823.288733:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863823.288736:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863823.288738:0:17078:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788863823.288740:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863823.288743:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863823.288744:0:17078:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788863823.288747:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788863823.288753:0:17078:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:2.0:1788863823.288777:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863823.288799:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89e5428ecd40) 00000020:00000080:2.0:1788863823.288812:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788863823.288818:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788863823.288872:0:17078:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788863823.288878:0:17078:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788863823.288883:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69e8e 00010000:00080000:2.0:1788863823.288916:0:17078:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e671be9000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863823.294719:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788863823.299650:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863823.299696:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788863823.299743:0:17078:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788863823.299764:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b69e95 00000100:00080000:3.0:1788863823.299775:0:17078:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863823.299786:0:17078:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e671be9000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863823.299822:0:17078:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5440c1500 x1875759226594432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863823.299852:0:17078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788863823.299996:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863823.300010:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.300012:0:17078:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788863823.300016:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788863823.300018:0:17078:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788863823.300020:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788863823.300022:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788863823.300024:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788863823.300026:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.300028:0:17078:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788863823.300030:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788863823.300035:0:17078:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788863823.300038:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.300039:0:17078:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788863823.300042:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788863823.300045:0:17078:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:3.0:1788863823.300072:0:17078:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788863823.300180:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788863823.300203:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89e543a199c0) 00000020:00000080:3.0:1788863823.300227:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788863823.300234:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788863823.300469:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226594432:0@lo:38:llog_process_th.0 00000004:00080000:3.0:1788863823.300535:0:17078:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788863823.300543:0:17078:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000100:00100000:2.0:1788863823.300548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788863823.300551:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69ea3 00010000:00080000:3.0:1788863823.300591:0:17078:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e5425b0800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00000100:00100000:0.0:1788863823.300677:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226594432 00000100:00100000:0.0:1788863823.300686:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226594432 00000100:00100000:0.0:1788863823.300728:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863823.300736:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226594432:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788863823.300752:0:17065:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788863823.300802:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226594432:12345-0@lo:38:llog_process_th.0 Request processed in 65us (254us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788863823.300818:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788863823.300824:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00080000:2.0:1788863823.300883:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863823.300888:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788863823.300891:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226594432:0@lo:38:llog_process_th.0 00000040:01000000:3.0:1788863823.303221:0:17078:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788863823.306276:0:17078:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788863823.313384:0:17078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863823.315112:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788863823.321657:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788863823.324926:0:17084:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788863823.324944:0:17084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788863823.326851:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788863823.326889:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788863823.327020:0:17078:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788863823.327042:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b69eaa 00000100:00080000:1.0:1788863823.327054:0:17078:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863823.327065:0:17078:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e5425b0800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863823.327116:0:17078:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4baa00 x1875759226594560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863823.327189:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226594560:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788863823.327280:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226594560 offset 0 length 520: 4 00000100:00080000:1.0:1788863823.327342:0:17078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788863823.327411:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863823.327416:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863823.327418:0:17078:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788863823.327421:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788863823.327430:0:17078:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788863823.327432:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788863823.327433:0:17078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788863823.327435:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788863823.327438:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863823.327439:0:17078:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788863823.327442:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788863823.327445:0:17078:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788863823.327448:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863823.327450:0:17078:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788863823.327452:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788863823.327455:0:17078:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1788863823.327474:0:17078:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788863823.327476:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863823.327489:0:17078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89e6763c0000) 00000020:00000080:1.0:1788863823.327508:0:17078:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788863823.327513:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788863823.327573:0:17078:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788863823.327579:0:17078:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788863823.327586:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b69eb8 00010000:00080000:1.0:1788863823.327613:0:17078:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e676341000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788863823.327818:0:17078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788863823.329129:0:17078:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788863823.331812:0:17078:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788863823.335532:0:17078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863823.336350:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788863823.336510:0:17078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788863823.338208:0:17086:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788863823.338224:0:17086:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788863823.339497:0:17078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863823.339511:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788863823.339558:0:17078:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788863823.339579:0:17078:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b69ebf 00000100:00080000:3.0:1788863823.339590:0:17078:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863823.339602:0:17078:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e676341000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863823.339639:0:17078:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5440c3b80 x1875759226594688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863823.339728:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226594688:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788863823.339783:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226594688 offset 0 length 520: 4 00000100:00080000:3.0:1788863823.339843:0:17078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788863823.339926:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863823.339932:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.339934:0:17078:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788863823.339938:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863823.339943:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.339944:0:17078:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863823.339948:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863823.339949:0:17078:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788863823.339952:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863823.339955:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.339956:0:17078:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788863823.339958:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863823.339961:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.339962:0:17078:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788863823.339965:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788863823.339993:0:17078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17078:1875759226594816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863823.340042:0:17078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863823.340073:0:17078:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6599459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863823.340137:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226594816 00000100:00100000:1.0:1788863823.340145:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226594816 00000100:00100000:1.0:1788863823.340194:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863823.340204:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17078:x1875759226594816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863823.340335:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17078:x1875759226594816:12345-0@lo:502:llog_process_th.0 Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863823.340344:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863823.340557:0:17078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17078:1875759226594816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863823.340582:0:17078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863823.340586:0:17078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.340588:0:17078:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788863823.340592:0:17078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788863823.341185:0:17039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788863823.341207:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788863823.341228:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.341241:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863823.341250:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5448c2800 from 1 10000000:01000000:2.0:1788863823.341256:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863823.341297:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.341306:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.341317:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.341335:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226594944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788863823.341373:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.341410:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863823.341773:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226594944 00000100:00100000:3.0:1788863823.341786:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226594944 00000100:00100000:3.0:1788863823.341829:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863823.341837:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+9:17039:x1875759226594944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863823.341847:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863823.341862:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69ec6 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.341882:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.341892:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.341899:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98a00, rc 0) 00000100:00100000:3.0:1788863823.341934:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+10:17039:x1875759226594944:12345-0@lo:101:mount.lustre.0 Request processed in 97us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863823.341940:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863823.343281:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226594944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863823.343301:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.343311:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.343798:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595072:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788863823.343858:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.343958:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.343982:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595072 00000100:00100000:2.0:1788863823.343988:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595072 00000100:00100000:2.0:1788863823.344024:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863823.344030:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+10:17039:x1875759226595072:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788863823.344045:0:17053:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788863823.344050:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788863823.344350:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+10:17039:x1875759226595072:12345-0@lo:256:mount.lustre.0 Request processed in 320us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.344357:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863823.344395:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595072:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788863823.345164:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863823.345232:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.345244:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863823.345251:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5448c2800 from 1 10000000:01000000:2.0:1788863823.345254:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863823.345285:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.345293:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.345301:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863823.345318:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788863823.345358:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863823.345401:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5429a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863823.345463:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595200 00000100:00100000:3.0:1788863823.345469:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595200 00000100:00100000:3.0:1788863823.345510:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863823.345518:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+10:17039:x1875759226595200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863823.345528:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863823.345540:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69ed4 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.345561:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 11 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.345571:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 11 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863823.345589:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98800, rc 0) 00000100:00100000:3.0:1788863823.345634:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17039:x1875759226595200:12345-0@lo:101:mount.lustre.0 Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863823.345640:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788863823.345788:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863823.345801:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863823.345811:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863823.345887:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863823.345927:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.345947:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863823.346048:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595328 00000100:00100000:3.0:1788863823.346053:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595328 00000100:00100000:3.0:1788863823.346106:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788863823.346112:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17039:x1875759226595328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863823.346245:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17039:x1875759226595328:12345-0@lo:501:mount.lustre.0 Request processed in 133us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863823.346252:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863823.349543:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863823.349606:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863823.349683:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.349723:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.349881:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595456 00000100:00100000:2.0:1788863823.349888:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595456 00000100:00100000:2.0:1788863823.349950:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863823.349959:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17039:x1875759226595456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863823.350071:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17039:x1875759226595456:12345-0@lo:503:mount.lustre.0 Request processed in 113us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.350099:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863823.350262:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863823.350771:0:17088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17088:1875759226595584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863823.350813:0:17088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863823.350847:0:17088:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6599453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.350894:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595584 00000100:00100000:2.0:1788863823.350910:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595584 00000100:00100000:2.0:1788863823.350945:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863823.350953:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17088:x1875759226595584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863823.351479:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17088:x1875759226595584:12345-0@lo:502:llog_process_th.0 Request processed in 525us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.351487:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863823.351986:0:17088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17088:1875759226595584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863823.352026:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863823.352036:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.352038:0:17088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788863823.352045:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5448c2800 00000020:00000080:3.0:1788863823.352047:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863823.352054:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863823.352056:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.352057:0:17088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788863823.352059:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863823.352061:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.352063:0:17088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788863823.352097:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5448c2800 00000020:00000080:3.0:1788863823.352100:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863823.352219:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863823.352224:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.352225:0:17088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788863823.352228:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863823.352230:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.352232:0:17088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863823.352236:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5448c2800 00000020:00000080:3.0:1788863823.352238:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863823.354039:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863823.354050:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.354053:0:17088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863823.354057:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863823.354060:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863823.354062:0:17088:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788863823.354066:0:17088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5448c2800 00000020:00000080:3.0:1788863823.354068:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863823.354163:0:17088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17088:1875759226595712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863823.354246:0:17088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863823.354288:0:17088:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886900 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.354369:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595712 00000100:00100000:2.0:1788863823.354377:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595712 00000100:00100000:2.0:1788863823.354432:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863823.354441:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17088:x1875759226595712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863823.354553:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17088:x1875759226595712:12345-0@lo:502:llog_process_th.0 Request processed in 112us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.354561:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863823.354613:0:17088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17088:1875759226595712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863823.354640:0:17088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863823.354647:0:17088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863823.354649:0:17088:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788863823.354653:0:17088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788863823.358192:0:17039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788863823.358247:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863823.358276:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863823.358290:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863823.358363:0:17039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788863823.358366:0:17039:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e5448c2800 10000000:01000000:0.0:1788863823.358369:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e5448c2800 10000000:01000000:0.0:1788863823.358374:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863823.358380:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e5448c2800 from 1 10000000:01000000:0.0:1788863823.358383:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863823.358424:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863823.358432:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863823.358443:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863823.358532:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788863823.358602:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.358647:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5440779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863823.363285:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595840 00000100:00100000:2.0:1788863823.363298:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595840 00000100:00100000:2.0:1788863823.363357:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863823.363367:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17039:x1875759226595840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863823.363395:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863823.363413:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e641536c00/0xf569beb9d4b69ee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69ee2 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.363445:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e641536c00/0xf569beb9d4b69ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69ee2 expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.363456:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e641536c00/0xf569beb9d4b69ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69ee2 expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863823.363465:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641536c00, rc 0) 00000100:00100000:2.0:1788863823.363540:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17039:x1875759226595840:12345-0@lo:101:mount.lustre.0 Request processed in 175us (4938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863823.363547:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863823.363644:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863823.363667:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863823.363677:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863823.363770:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863823.363808:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863823.363842:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226595968 00000100:00100000:3.0:1788863823.363847:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226595968 00000100:00100000:0.0:1788863823.363862:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5440779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863823.363879:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788863823.363887:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17039:x1875759226595968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863823.364069:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17039:x1875759226595968:12345-0@lo:501:mount.lustre.0 Request processed in 178us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863823.364097:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863823.364628:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226595968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863823.364680:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226596096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863823.364773:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.364801:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5440779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863823.364819:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596096 00000100:00100000:0.0:1788863823.364823:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596096 00000100:00100000:0.0:1788863823.364852:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863823.364860:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+13:17039:x1875759226596096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863823.364960:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+13:17039:x1875759226596096:12345-0@lo:503:mount.lustre.0 Request processed in 99us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863823.364968:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863823.365017:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226596096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863823.366495:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17092:1875759226596224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863823.366564:0:17092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.366634:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596224 00000100:00100000:0.0:1788863823.366640:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596224 00000100:00100000:0.0:1788863823.366686:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863823.366699:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17092:x1875759226596224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863823.366823:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17092:x1875759226596224:12345-0@lo:502:llog_process_th.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863823.366832:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863823.366885:0:17092:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e544077240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863823.366907:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17092:1875759226596224:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788863823.366967:0:17092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788863823.367246:0:17092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89e658628000) 00000020:00000080:0.0:1788863823.367267:0:17092:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788863823.367368:0:17092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5448c2800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788863823.367374:0:17092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5448c2800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788863823.367377:0:17092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5448c2800 4 00010000:00080000:0.0:1788863823.367409:0:17092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e5425c8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788863823.370352:0:17092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788863823.371016:0:17092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788863823.371071:0:17092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788863823.371108:0:17092:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf569beb9d4b69ef7 00000100:00080000:0.0:1788863823.371119:0:17092:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788863823.371132:0:17092:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89e5425c8800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863823.371246:0:17092:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dc000 x1875759226596352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863823.371278:0:17092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788863823.372280:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226596352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788863823.372354:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.377533:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17092:1875759226596480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863823.377753:0:17092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.377807:0:17092:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e651d7a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788863823.377823:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596352 00000100:00100000:0.0:1788863823.377832:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596480 00000100:00100000:1.0:1788863823.377837:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596352 00000100:00100000:0.0:1788863823.377839:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596480 00000100:00100000:1.0:1788863823.377880:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863823.377881:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863823.377892:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226596352:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788863823.377894:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17092:x1875759226596480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863823.377964:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226596352:12345-0@lo:38:llog_process_th.0 Request processed in 73us (5608us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788863823.377971:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863823.378014:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17092:x1875759226596480:12345-0@lo:502:llog_process_th.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863823.378022:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788863823.378105:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17092:1875759226596480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863823.378165:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17092:1875759226596608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863823.378203:0:17092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.378239:0:17092:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681c5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863823.378276:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596608 00000100:00100000:0.0:1788863823.378280:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596608 00000100:00100000:0.0:1788863823.378305:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863823.378311:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17092:x1875759226596608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863823.378389:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17092:x1875759226596608:12345-0@lo:502:llog_process_th.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863823.378396:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863823.378438:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dea3065e-0e63-4370-a87c-9d4f07265d5e:17092:1875759226596608:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788863823.378457:0:17092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788863823.378582:0:17039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:2.0:1788863823.379012:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788863823.379020:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863823.379025:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788863823.379028:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226596352:0@lo:38:llog_process_th.0 10000000:01000000:0.0:1788863823.379226:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788863823.379247:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863823.379259:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788863823.379309:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788863823.379312:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788863823.379313:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863823.379315:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863823.379317:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863823.379318:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863823.379319:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863823.379321:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788863823.379322:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863823.379324:0:17039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788863823.379328:0:17039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788863823.379334:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863823.379336:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788863823.379337:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863823.379338:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863823.379339:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863823.379340:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863823.379341:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863823.379342:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788863823.379343:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863823.379344:0:17039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788863823.379362:0:17039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788863823.379373:0:17039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226596736:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788863823.379416:0:17039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863823.379445:0:17039:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e681c5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863823.379462:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596736 00000100:00100000:0.0:1788863823.379468:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596736 00000100:00100000:0.0:1788863823.379497:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863823.379505:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17039:x1875759226596736:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863823.379526:0:17054:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788863823.379542:0:17054:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788863823.388481:0:17054:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788863823.388504:0:17054:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788863823.388640:0:17076:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788863823.388646:0:17076:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788863823.388670:0:17076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.388689:0:17076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.388699:0:17076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.388808:0:17076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.388823:0:17076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 12 pid: 17055 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863823.388839:0:17076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226596864:0@lo:104: 00000100:00100000:0.0:1788863823.388869:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17039:x1875759226596736:12345-0@lo:253:mount.lustre.0 Request processed in 9362us (9450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863823.388881:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788863823.388899:0:17076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863823.388941:0:17076:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863823.388944:0:17039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17039:1875759226596736:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788863823.388957:0:17039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788863823.388960:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788863823.388962:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788863823.388964:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863823.388965:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863823.388967:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863823.388989:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863823.388990:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863823.388992:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:1.0:1788863823.388993:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596864 00000020:01000004:0.0:1788863823.388994:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863823.388998:0:17039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788863823.389002:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596864 00000020:02000000:0.0:1788863823.389013:0:17039:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788863823.389041:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863823.389050:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226596864:12345-0@lo:104: 00010000:00010000:1.0:1788863823.389295:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.389342:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863823.389348:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226596864:12345-0@lo:104: Request processed in 299us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863823.389354:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863823.389384:0:17076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226596864:0@lo:104: 00010000:00010000:1.0:1788863823.389398:0:17076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.389648:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863823.389655:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.389664:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863823.389668:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.389676:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863823.389684:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863823.389690:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863823.389721:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.389728:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863823.389840:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.389848:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537400/0xf569beb9d4b69ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69ecd expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.389864:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863823.389867:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863823.389869:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863823.390156:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226596992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863823.390197:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863823.390339:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226596992 00000100:00100000:1.0:1788863823.390346:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226596992 00010000:00010000:1.0:1788863823.390368:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 12 pid: 17055 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863823.390397:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863823.390405:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:3643:x1875759226596992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863823.390418:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863823.390424:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 12 pid: 17055 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390436:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 12 pid: 17055 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390451:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b69ecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b69ec6 expref: 12 pid: 17055 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390465:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390483:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788863823.390495:0:17045:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001850704s 00010000:00010000:1.0:1788863823.390500:0:17045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390506:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390514:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390520:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390525:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fe00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863823.390529:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390609:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390629:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390640:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863823.390676:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:3643:x1875759226596992:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863823.390684:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788863823.390720:0:17076:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390728:0:17076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863823.390734:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b69efe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863823.390847:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226596992:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788863823.418007:0:17039:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788863823.427583:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788863823.427800:0:17100:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788863823.427805:0:17100:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788863823.428119:0:17101:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788863823.428482:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788863823.428892:0:17101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788863823.430704:0:17102:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff89e66d4b9180 x1875759226597120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863823.430718:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000040:01000000:3.0:1788863823.431562:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788863823.431614:0:17039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863823.432659:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788863823.432745:0:17101:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1788863823.433282:0:17039:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788863823.438259:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788863823.438367:0:17039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863823.440720:0:17039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788863823.444101:0:17039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788863823.444304:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788863823.446185:0:17039:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1788863823.447119:0:17039:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788863823.451653:0:17039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788863823.456821:0:17039:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788863823.456867:0:17039:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4a9c1c2f988 00100000:10000000:2.0:1788863823.456875:0:17039:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788863823.458836:0:17039:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788863823.458854:0:17039:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788863823.458874:0:17039:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788863823.458890:0:17039:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788863823.471522:0:17039:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788863823.472981:0:17039:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788863824.109153:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788863824.428798:0:17098:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863824.428808:0:17098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863824.430913:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788863824.430926:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788863824.492473:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 10000000:01000000:1.0:1788863824.683463:0:17058:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788863824.683472:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5448c2800 from 7 10000000:01000000:1.0:1788863824.683477:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788863824.683524:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863824.683537:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863824.683548:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863824.683583:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226597248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863824.683652:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863824.683721:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863824.683740:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226597248 00000100:00100000:2.0:1788863824.683748:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226597248 00000100:00100000:2.0:1788863824.683811:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788863824.683820:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+11:17058:x1875759226597248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863824.683834:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863824.683847:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69f05 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863824.683871:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863824.683882:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863824.683892:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e641536000, rc 0) 00000100:00100000:2.0:1788863824.683945:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17058:x1875759226597248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863824.683952:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788863824.684059:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226597248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863824.684098:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863824.684107:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863824.684156:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226597376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788863824.684197:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863824.684225:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863824.685351:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226597376 00000100:00100000:2.0:1788863824.685368:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226597376 00000100:00100000:2.0:1788863824.685458:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863824.685467:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17058:x1875759226597376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788863824.685486:0:17054:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788863824.685501:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788863824.685504:0:17054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788863824.685612:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17058:x1875759226597376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863824.685619:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863824.687484:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226597376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788863824.687543:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863824.687552:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863824.687563:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863825.132512:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788863825.455119:0:17098:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863825.455133:0:17098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863825.455336:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788863825.455381:0:17098:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863825.455566:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:3.0:1788863825.515218:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:1.0:1788863826.156466:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863826.540272:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:1.0:1788863827.187607:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863827.563151:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000001:02000400:3.0:1788863827.921862:0:17345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788863828.203629:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863828.466928:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788863828.466935:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788863828.466938:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863828.466946:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:1.0:1788863828.466952:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863828.466965:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e671be9000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863828.466989:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b9880 x1875759226597632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863828.467018:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863828.467022:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863828.467025:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863828.467028:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863828.467030:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788863828.467033:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863828.467035:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e5425c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863828.467041:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89e5425c8800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863828.467054:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b9500 x1875759226597760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863828.467147:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863828.467160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226597504:0@lo:400:kworker.0 00000100:00100000:1.0:1788863828.467232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863828.467301:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226597504 00000100:00100000:1.0:1788863828.467309:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226597504 00000100:00100000:1.0:1788863828.467351:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863828.467359:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:3641:x1875759226597504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863828.467407:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:3641:x1875759226597504:12345-0@lo:400:kworker.0 Request processed in 49us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863828.467414:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863828.467463:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226597504:0@lo:400:kworker.0 00000100:00100000:3.0:1788863828.470645:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226597632:0@lo:38:kworker.0 00000100:00100000:3.0:1788863828.470723:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863828.470808:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226597760:0@lo:38:kworker.0 00000100:00100000:3.0:1788863828.471349:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863828.471667:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226597760 00000100:00100000:1.0:1788863828.471676:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226597760 00000100:00100000:1.0:1788863828.471724:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863828.471731:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226597760:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788863828.471756:0:17062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:1.0:1788863828.471789:0:17062:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf569beb9d4b69f13 00000004:00100000:1.0:1788863828.471811:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788863828.471927:0:17062:0:(import.c:65:import_set_state_nolock()) ffff89e543a44000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863828.471982:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875759226597760:12345-0@lo:38:kworker.0 Request processed in 250us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863828.471989:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788863828.472039:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e66d4b9500 x1875759226597760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863828.472054:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788863828.472061:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788863828.472065:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788863828.472067:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788863828.472072:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226597760:0@lo:38:kworker.0 00000100:00100000:0.0:1788863828.472865:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226597632 00000100:00100000:0.0:1788863828.472874:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226597632 00000100:00100000:1.0:1788863828.473285:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863828.473292:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226597632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788863828.473310:0:17065:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788863828.505070:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226597632:12345-0@lo:38:kworker.0 Request processed in 31768us (34337us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863828.505118:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788863828.506294:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863828.506303:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863828.506308:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226597632:0@lo:38:kworker.0 00000100:00100000:3.0:1788863828.589174:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000020:00000004:1.0:1788863829.070985:0:17397:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863829.071397:0:17397:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863829.231049:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863829.613471:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:1.0:1788863830.251372:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863830.263668:0:17447:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863830.267592:0:17447:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788863830.635213:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:1.0:1788863831.278422:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863831.660301:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:0.0:1788863832.307187:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863832.684242:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:0.0:1788863833.327208:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863833.580176:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863823/real 1788863823] req@ffff89e5440c3b80 x1875759226594688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863833 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863833.580206:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5440c3b80 x1875759226594688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863833 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863833.580217:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863823/real 1788863823] req@ffff89e66d4baa00 x1875759226594560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863833 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863833.580227:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e66d4baa00 x1875759226594560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863833 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863833.580247:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863833.580254:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:2.0:1788863833.580255:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1788863833.580258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226594688:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788863833.580260:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788863833.580262:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863833.580263:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863833.580268:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788863833.580268:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788863833.580271:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226594560:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788863833.580273:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788863833.580290:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e671be9000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863833.580309:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543b7a300 x1875759226598016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863833.580330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788863833.580334:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788863833.580335:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788863833.580338:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:2.0:1788863833.580341:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788863833.580345:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e5425b0800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863833.580357:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543b79c00 x1875759226598144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863833.580365:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788863833.580367:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788863833.580369:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788863833.580372:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:2.0:1788863833.580374:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788863833.580378:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e676341000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863833.580389:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543b79180 x1875759226598272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863833.580446:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226597888:0@lo:400:kworker.0 00000100:00100000:2.0:1788863833.580503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863833.580561:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863833.580568:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226598400:0@lo:400:kworker.0 00000100:00100000:2.0:1788863833.580595:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863833.580631:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226597888 00000100:00100000:2.0:1788863833.580640:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226597888 00000100:00100000:2.0:1788863833.580680:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863833.580688:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:3641:x1875759226597888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863833.580734:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:3641:x1875759226597888:12345-0@lo:400:kworker.0 Request processed in 46us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863833.580741:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863833.580785:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226597888:0@lo:400:kworker.0 00000100:00100000:1.0:1788863833.580915:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226598400 00000100:00100000:1.0:1788863833.580919:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226598400 00000100:00100000:1.0:1788863833.580955:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863833.580962:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226598400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863833.581004:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226598400:12345-0@lo:400:kworker.0 Request processed in 42us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863833.581022:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788863833.581061:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e543b78000 x1875759226598400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863833.581072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226598400:0@lo:400:kworker.0 00000100:00100000:1.0:1788863833.581114:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226598016:0@lo:38:kworker.0 00000100:00100000:1.0:1788863833.581148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863833.581166:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226598144:0@lo:8:kworker.0 00000400:00000100:1.0:1788863833.581187:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226598144 offset 0 length 520: 4 00000100:00100000:1.0:1788863833.581207:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226598272:0@lo:8:kworker.0 00000400:00000100:1.0:1788863833.581223:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226598272 offset 0 length 520: 4 00000100:00100000:1.0:1788863833.581251:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226598016 00000100:00100000:1.0:1788863833.581255:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226598016 00000100:00100000:1.0:1788863833.581273:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863833.581279:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226598016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788863833.581296:0:17066:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788863833.601189:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226598016:12345-0@lo:38:kworker.0 Request processed in 19902us (20033us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863833.601202:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788863833.601261:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863833.601267:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863833.601272:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226598016:0@lo:38:kworker.0 00000100:00100000:0.0:1788863833.707176:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:0.0:1788863834.347308:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863834.731203:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:0.0:1788863835.381247:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863835.692230:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788863835.758524:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:2.0:1788863836.395353:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863836.780260:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:2.0:1788863837.419629:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788863837.597061:0:17792:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788863837.597066:0:17792:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788863837.597067:0:17792:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788863837.597313:0:17792:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e5425c9800 00000020:01000004:0.0:1788863837.597328:0:17792:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788863837.597339:0:17792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788863837.597361:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff89e66c648000) 00000020:00000080:0.0:1788863837.597375:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788863837.639478:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788863837.639724:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.643000:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.643401:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.643588:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.643809:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.644349:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.644532:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.644950:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.645291:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.645483:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.645660:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.645857:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.646045:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.646380:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.646603:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.646808:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.647029:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.648006:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.648531:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.648735:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.648948:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.649175:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.649568:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.649775:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.650092:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.650437:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.650671:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.650868:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.651337:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.651611:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.652054:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.652543:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788863837.652779:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788863837.653465:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788863837.653699:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788863837.654230:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788863837.654537:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788863837.655625:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788863837.656146:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788863837.656481:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788863837.656750:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788863837.657040:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788863837.657566:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788863837.657810:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788863837.658096:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1788863837.659697:0:17792:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788863837.660916:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788863837.660940:0:17792:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788863837.660954:0:17792:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b69f21 00000020:01000004:0.0:1788863837.660962:0:17792:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788863837.660994:0:17792:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788863837.660997:0:17792:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788863837.661003:0:17792:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788863837.661029:0:17792:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788863837.661034:0:17792:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788863837.674416:0:17792:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788863837.674474:0:17792:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.135@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788863837.674479:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788863837.674482:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788863837.674488:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863837.674489:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863837.674490:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863837.674491:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863837.674493:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863837.674494:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863837.674496:0:17792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788863837.674499:0:17792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788863837.674501:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863837.674502:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788863837.674503:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863837.674505:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863837.674505:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863837.674507:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863837.674508:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863837.674509:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863837.674510:0:17792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788863837.674553:0:17792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788863837.674574:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788863837.674643:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.674760:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863837.676252:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226598528 00000100:00100000:3.0:1788863837.676264:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226598528 00000100:00100000:3.0:1788863837.676395:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788863837.676405:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17792:x1875759226598528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788863837.676442:0:17055:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788863837.676446:0:17055:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788863837.676452:0:17055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788863837.677155:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17792:x1875759226598528:12345-0@lo:253:mount.lustre.0 Request processed in 750us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863837.677164:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863837.677286:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788863837.677302:0:17792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788863837.677306:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863837.677308:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788863837.677310:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863837.677312:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863837.677313:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863837.677314:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863837.677315:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863837.677317:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863837.677319:0:17792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788863837.677339:0:17792:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e5425c9800 from lustre-MDT0001 10000000:01000000:1.0:1788863837.677371:0:17792:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788863837.677374:0:17792:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788863837.677381:0:17792:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e5428e99c0 local copy 00010000:00010000:1.0:1788863837.677391:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.677510:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863837.677548:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.677591:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863837.678636:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226598656 00000100:00100000:2.0:1788863837.678645:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226598656 00000100:00100000:2.0:1788863837.678707:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788863837.678716:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17792:x1875759226598656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863837.678811:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17792:x1875759226598656:12345-0@lo:501:mount.lustre.0 Request processed in 97us (1262us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863837.678820:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863837.678882:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598656:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788863837.678901:0:17792:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788863837.678924:0:17792:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788863837.678962:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.678973:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863837.679000:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e5425c9800 10000000:01000000:1.0:1788863837.679006:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788863837.679010:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89e5428e99c0 10000000:01000000:1.0:1788863837.679013:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788863837.679016:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89e5428e99c0 from 1 10000000:01000000:1.0:1788863837.679019:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788863837.679047:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.679056:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.679065:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.679116:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863837.679147:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.679182:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863837.679209:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226598784 00000100:00100000:3.0:1788863837.679214:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226598784 00000100:00100000:3.0:1788863837.679255:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863837.679261:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+12:17792:x1875759226598784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863837.679270:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863837.679284:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99400/0xf569beb9d4b69f2f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69f28 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863837.679501:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99400/0xf569beb9d4b69f2f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69f28 expref: 13 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863837.679515:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99400/0xf569beb9d4b69f2f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69f28 expref: 13 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863837.679524:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99400, rc 0) 00000100:00100000:3.0:1788863837.679576:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+13:17792:x1875759226598784:12345-0@lo:101:mount.lustre.0 Request processed in 315us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863837.679583:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863837.679622:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863837.679636:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f2f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.679646:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69f2f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863837.679660:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788863837.679680:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f2f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.679688:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f2f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863837.679696:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e5425c9800 10000000:01000000:1.0:1788863837.679700:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788863837.679704:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89e5425c9800 from 1 10000000:01000000:1.0:1788863837.679706:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788863837.679720:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.679727:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.679733:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.679756:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863837.679785:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.680053:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226598912 00000100:00100000:2.0:1788863837.680059:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226598912 00000100:00100000:2.0:1788863837.680095:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788863837.680101:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+13:17792:x1875759226598912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863837.680109:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863837.680119:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650922400/0xf569beb9d4b69f3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69f36 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.680132:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650922400/0xf569beb9d4b69f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69f36 expref: 14 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.680151:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650922400/0xf569beb9d4b69f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69f36 expref: 14 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.680158:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922400, rc 0) 00000100:00100000:2.0:1788863837.680184:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+14:17792:x1875759226598912:12345-0@lo:101:mount.lustre.0 Request processed in 84us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.680189:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863837.683128:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.683174:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226598912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863837.683200:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.683214:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863837.683233:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788863837.683361:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.683370:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863837.683378:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788863837.683386:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863837.683393:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e5425c9800 10000000:01000000:1.0:1788863837.683396:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788863837.683400:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788863837.683403:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788863837.683434:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.683455:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.683480:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.683502:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863837.683574:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.683609:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863837.684554:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599040 00000100:00100000:2.0:1788863837.684565:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599040 00000100:00100000:2.0:1788863837.684623:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863837.684633:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+14:17792:x1875759226599040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863837.684648:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863837.684662:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650923200/0xf569beb9d4b69f4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69f44 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.684687:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650923200/0xf569beb9d4b69f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69f44 expref: 15 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.684698:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650923200/0xf569beb9d4b69f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69f44 expref: 15 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.684707:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650923200, rc 0) 00000100:00100000:2.0:1788863837.684772:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599040:12345-0@lo:101:mount.lustre.0 Request processed in 140us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.684780:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863837.686592:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863837.686615:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.686628:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863837.688748:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788863837.689571:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863837.697920:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788863837.697987:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788863837.698009:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788863837.698020:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788863837.698032:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1788863837.698043:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1788863837.698055:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1788863837.698067:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788863837.698796:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788863837.698836:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1788863837.698914:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1788863837.698945:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1788863837.698962:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1788863837.698984:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788863837.698999:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788863837.699011:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1788863837.699024:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788863837.699038:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788863837.699052:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1788863837.699064:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788863837.699356:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788863837.699379:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788863837.699395:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788863837.699426:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1788863837.699432:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1788863837.699537:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863837.699605:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.699656:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.699733:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599168 00000100:00100000:0.0:1788863837.699740:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599168 00000100:00100000:2.0:1788863837.699901:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863837.699912:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863837.700178:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599168:12345-0@lo:501:mount.lustre.0 Request processed in 268us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.700203:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863837.700478:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863837.700519:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863837.700565:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.700651:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863837.700809:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599296 00000100:00100000:3.0:1788863837.700822:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599296 00000100:00100000:3.0:1788863837.700893:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788863837.700903:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863837.701719:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599296:12345-0@lo:503:mount.lustre.0 Request processed in 815us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863837.701727:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863837.701830:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863837.702346:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863837.702431:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863837.702475:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.702996:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863837.703060:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599424 00000100:00100000:2.0:1788863837.703066:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599424 00000100:00100000:2.0:1788863837.703117:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863837.703124:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863837.703802:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599424:12345-0@lo:502:mount.lustre.0 Request processed in 676us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.703810:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863837.703889:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863837.704134:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788863837.704160:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788863837.704184:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1788863837.704195:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788863837.704205:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788863837.704215:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788863837.704226:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788863837.704248:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788863837.704262:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788863837.704282:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788863837.704296:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788863837.704308:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788863837.704319:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788863837.704332:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788863837.704345:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788863837.704357:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788863837.704369:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788863837.704381:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788863837.704393:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788863837.704404:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788863837.704415:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788863837.704426:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788863837.704439:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788863837.704450:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788863837.704461:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788863837.704471:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788863837.704482:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788863837.704493:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788863837.704503:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788863837.704513:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788863837.704523:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788863837.704533:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788863837.704544:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788863837.704554:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788863837.704564:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788863837.704574:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788863837.704584:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788863837.704594:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788863837.704604:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788863837.704614:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788863837.704624:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788863837.704636:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788863837.704654:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788863837.704665:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788863837.704695:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863837.704741:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.704766:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863837.705037:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599552 00000100:00100000:2.0:1788863837.705043:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599552 00000100:00100000:2.0:1788863837.705067:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863837.705094:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863837.705188:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226599552:12345-0@lo:502:mount.lustre.0 Request processed in 113us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.705195:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788863837.705436:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226599552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863837.705481:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788863837.705491:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788863837.706525:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863837.706538:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.706540:0:17796:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788863837.706547:0:17796:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788863837.706551:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863837.706577:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff89e681bf99c0) 00000020:00000080:2.0:1788863837.706598:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788863837.706605:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788863837.706677:0:17796:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788863837.706683:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b69f59 00000020:00000080:2.0:1788863837.706980:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788863837.706984:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863837.706987:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.706994:0:17796:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788863837.706998:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863837.707002:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.707004:0:17796:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788863837.707007:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863837.707015:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff89e681bfcd40) 00000020:00000080:2.0:1788863837.707026:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788863837.707030:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788863837.707032:0:17796:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788863837.707035:0:17796:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788863837.707040:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788863837.707356:0:17796:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5425c9800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788863837.707370:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff89e681bfb380) 00000020:00000080:2.0:1788863837.707381:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788863837.707435:0:17796:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788863837.707440:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b69f6e 00000020:00000080:2.0:1788863837.707529:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788863837.707536:0:17796:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788863837.707540:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf569beb9d4b69f75 00080000:01000000:2.0:1788863837.707545:0:17796:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788863837.707548:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b69f7c 00010000:00010000:2.0:1788863837.789701:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788863837.792693:0:17796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788863837.793408:0:17796:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788863837.794599:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788863837.794612:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863837.794619:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.794621:0:17796:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788863837.794624:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863837.794631:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.794632:0:17796:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788863837.794635:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788863837.794641:0:17796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:2.0:1788863837.794674:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863837.794689:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff89e681bf8000) 00000020:00000080:2.0:1788863837.794709:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788863837.794714:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788863837.794775:0:17796:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788863837.794782:0:17796:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788863837.794790:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b69f8a 00010000:00080000:2.0:1788863837.794922:0:17796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e544170000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863837.799063:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000100:00100000:2.0:1788863837.806447:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000020:00000080:0.0:1788863837.812462:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788863837.812479:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788863837.812524:0:17796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788863837.812547:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b69f91 00000100:00080000:0.0:1788863837.812558:0:17796:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788863837.812569:0:17796:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89e544170000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863837.812606:0:17796:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438ddf80 x1875759226599680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863837.812641:0:17796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788863837.812671:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788863837.812677:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788863837.812679:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863837.812683:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1788863837.812700:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788863837.812706:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e671be9000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863837.812722:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438ded80 x1875759226599808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863837.812805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863837.812808:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863837.812812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863837.812815:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788863837.812892:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863837.812896:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863837.812898:0:17796:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788863837.812902:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788863837.812905:0:17796:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788863837.812907:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863837.812908:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863837.812910:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788863837.812912:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863837.812914:0:17796:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788863837.812916:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863837.812920:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863837.812922:0:17796:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788863837.812937:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788863837.812968:0:17796:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788863837.813131:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226599680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788863837.813207:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863837.813262:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226599808:0@lo:38:kworker.0 00000100:00100000:3.0:1788863837.813284:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788863837.813369:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788863837.813385:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599680 00000100:00100000:0.0:1788863837.813392:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599680 00000100:00100000:0.0:1788863837.813412:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599808 00000100:00100000:0.0:1788863837.813414:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599808 00000100:00100000:0.0:1788863837.813426:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788863837.813441:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226599680:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788863837.813468:0:17065:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788863837.813512:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b69f98 00000004:00100000:0.0:1788863837.813525:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788863837.813532:0:17065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000080:0.0:1788863837.813604:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863837.813606:0:17796:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788863837.813610:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788863837.813613:0:17796:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788863837.813614:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863837.813616:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863837.813617:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788863837.813620:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863837.813622:0:17796:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788863837.813624:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788863837.813628:0:17796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788863837.813631:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863837.813633:0:17796:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788863837.813636:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788863837.813640:0:17796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:0.0:1788863837.813660:0:17796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788863837.813663:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788863837.813677:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff89e66c6499c0) 00000020:00000080:0.0:1788863837.813692:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788863837.813697:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788863837.814308:0:17796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788863837.814317:0:17796:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788863837.814325:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b69fa6 00000100:00100000:1.0:1788863837.814473:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226599936:0@lo:400:kworker.0 00000100:00100000:1.0:1788863837.814530:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788863837.814565:0:17796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e544175800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788863837.814914:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788863837.815957:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226599936 00000100:00100000:3.0:1788863837.815969:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226599936 00000100:00100000:3.0:1788863837.816022:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863837.816031:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226599936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863837.816129:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226599936:12345-0@lo:400:kworker.0 Request processed in 99us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863837.816145:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788863837.816424:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e5438dea00 x1875759226599936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863837.816441:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226599936:0@lo:400:kworker.0 00000040:01000000:2.0:1788863837.821187:0:17796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788863837.821560:0:17796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788863837.824107:0:17796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863837.824406:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788863837.824550:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000020:00000080:2.0:1788863837.825995:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788863837.826009:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788863837.826046:0:17796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788863837.826107:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b69fad 00000100:00080000:2.0:1788863837.826120:0:17796:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863837.826131:0:17796:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89e544175800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863837.826182:0:17796:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543b79880 x1875759226600064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863837.826215:0:17796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788863837.826273:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863837.826278:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.826280:0:17796:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788863837.826284:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788863837.826287:0:17796:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788863837.826289:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788863837.826291:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788863837.826299:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788863837.826302:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.826304:0:17796:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788863837.826307:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788863837.826311:0:17796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788863837.826315:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.826316:0:17796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000100:00100000:0.0:1788863837.826321:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226600064:0@lo:8:llog_process_th.0 00000020:00000080:2.0:1788863837.826327:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788863837.826333:0:17796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1788863837.826356:0:17796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788863837.826359:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863837.826381:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff89e67b6c19c0) 00000400:00000100:0.0:1788863837.826390:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226600064 offset 0 length 520: 4 00000020:00000080:2.0:1788863837.826402:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788863837.826410:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:0.0:1788863837.826461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863837.826466:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863837.826469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863837.826472:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:2.0:1788863837.826485:0:17796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788863837.826494:0:17796:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788863837.826501:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b69fbb 00010000:00080000:2.0:1788863837.826530:0:17796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e67b6ae000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863837.826751:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788863837.826817:0:17796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788863837.826833:0:17796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788863837.827410:0:17801:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788863837.827417:0:17801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1788863837.829396:0:17065:0:(import.c:65:import_set_state_nolock()) ffff89e544176000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863837.829506:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226599680:12345-0@lo:38:llog_process_th.0 Request processed in 16061us (16294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.829518:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788863837.829559:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863837.829566:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226599808:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788863837.829606:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226599808:12345-0@lo:38:kworker.0 Request processed in 39us (16321us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788863837.829612:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863837.829944:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863837.829954:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788863837.829962:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788863837.829967:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788863837.829970:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788863837.829989:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226599680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788863837.830000:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863837.830004:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863837.830007:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788863837.830010:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226599808:0@lo:38:kworker.0 00000100:00100000:1.0:1788863837.830253:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863837.830269:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226600192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863837.830315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863837.830370:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226600192 00000100:00100000:0.0:1788863837.830377:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226600192 00000100:00100000:0.0:1788863837.830419:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863837.830426:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226600192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863837.830451:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788863837.830491:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226600192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.830497:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863837.830914:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226600192:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788863837.831510:0:17796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788863837.831696:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788863837.831899:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788863837.832651:0:17803:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788863837.832656:0:17803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788863837.833538:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788863837.833550:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788863837.833590:0:17796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788863837.833613:0:17796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b69fc2 00000100:00080000:3.0:1788863837.833623:0:17796:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863837.833634:0:17796:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e67b6ae000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863837.833669:0:17796:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5440c2300 x1875759226600320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863837.833689:0:17796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788863837.833743:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863837.833754:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863837.833756:0:17796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788863837.833760:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863837.833763:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863837.833765:0:17796:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863837.833768:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863837.833769:0:17796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788863837.833771:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863837.833774:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863837.833775:0:17796:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788863837.833777:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863837.833778:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863837.833779:0:17796:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788863837.833783:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788863837.833807:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863837.833809:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863837.833810:0:17796:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788863837.833827:0:17796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:0.0:1788863837.833995:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226600320:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788863837.834048:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226600320 offset 0 length 520: 4 00000020:01000000:1.0:1788863837.834205:0:17792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788863837.834331:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788863837.834348:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.834359:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863837.834378:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5425c9800 from 1 10000000:01000000:1.0:1788863837.834381:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788863837.834407:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.834415:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.834426:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.834443:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863837.834481:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.834507:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015b000 going to sleep for 11 seconds 00000100:00080000:1.0:1788863837.834526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863837.834530:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863837.834533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863837.834536:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788863837.834900:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226600448 00000100:00100000:2.0:1788863837.834907:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226600448 00000100:00100000:2.0:1788863837.834966:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863837.834975:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+15:17792:x1875759226600448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863837.834988:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863837.835002:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69fc9 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.835024:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 16 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.835046:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 16 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.835241:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650923a00, rc 0) 00000100:00100000:2.0:1788863837.835290:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:17792:x1875759226600448:12345-0@lo:101:mount.lustre.0 Request processed in 316us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.835297:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863837.835421:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863837.835435:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.835443:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.835994:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600576:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788863837.836040:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.836110:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863837.836174:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226600576 00000100:00100000:3.0:1788863837.836179:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226600576 00000100:00100000:3.0:1788863837.836210:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863837.836217:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:17792:x1875759226600576:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788863837.836238:0:17055:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788863837.836256:0:17055:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788863837.836259:0:17055:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788863837.836347:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:17792:x1875759226600576:12345-0@lo:256:mount.lustre.0 Request processed in 129us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863837.836353:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788863837.836469:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600576:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788863837.837012:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788863837.837032:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.837043:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863837.837052:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5425c9800 from 1 10000000:01000000:1.0:1788863837.837054:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863837.837097:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.837105:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.837113:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.837127:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863837.837156:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.837182:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.837198:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226600704 00000100:00100000:1.0:1788863837.837202:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226600704 00000100:00100000:1.0:1788863837.837224:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788863837.837298:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:17792:x1875759226600704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863837.837317:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863837.837327:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69fd7 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.837345:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.837354:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.837362:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ec00, rc 0) 00000100:00100000:1.0:1788863837.837392:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226600704:12345-0@lo:101:mount.lustre.0 Request processed in 163us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863837.837398:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788863837.837434:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863837.837446:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.837454:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863837.837566:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863837.837591:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863837.837613:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.837624:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae146c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.837635:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226600832 00000100:00100000:1.0:1788863837.837637:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226600832 00000100:00100000:1.0:1788863837.837650:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788863837.837660:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226600832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863837.837725:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226600832:12345-0@lo:501:mount.lustre.0 Request processed in 66us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863837.837732:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788863837.837760:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863837.837783:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863837.837821:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.837832:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae146c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.837845:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226600960 00000100:00100000:1.0:1788863837.837848:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226600960 00000100:00100000:1.0:1788863837.837864:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788863837.837869:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226600960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863837.837964:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226600960:12345-0@lo:503:mount.lustre.0 Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863837.837969:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788863837.838003:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226600960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863837.838725:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863837.838790:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863837.838903:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.838998:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae14e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863837.839386:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601088 00000100:00100000:2.0:1788863837.839394:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601088 00000100:00100000:2.0:1788863837.839466:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863837.839474:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226601088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863837.839633:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226601088:12345-0@lo:502:mount.lustre.0 Request processed in 160us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.839640:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863837.839728:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788863837.839952:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788863837.839982:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788863837.840006:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788863837.840019:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788863837.840029:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788863837.840041:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788863837.840311:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788863837.840331:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788863837.840344:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788863837.840357:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788863837.840370:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788863837.840409:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863837.840453:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863837.840482:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.841204:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601216 00000100:00100000:0.0:1788863837.841218:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601216 00000100:00100000:0.0:1788863837.841371:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863837.841382:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226601216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863837.841514:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226601216:12345-0@lo:502:mount.lustre.0 Request processed in 134us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.841521:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863837.842093:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788863837.842173:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788863837.842185:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788863837.842833:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863837.842844:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.842846:0:17805:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788863837.842853:0:17805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5425c9800 00000020:00000080:2.0:1788863837.842855:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863837.842862:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863837.842865:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.842866:0:17805:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788863837.842868:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863837.842871:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.842872:0:17805:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788863837.842875:0:17805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5425c9800 00000020:00000080:2.0:1788863837.842878:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863837.842945:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863837.842953:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.842955:0:17805:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788863837.842958:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863837.842961:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.842962:0:17805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788863837.842965:0:17805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5425c9800 00000020:00000080:2.0:1788863837.842967:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863837.842985:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863837.842988:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.842989:0:17805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788863837.842992:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863837.842994:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.842995:0:17805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788863837.842998:0:17805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5425c9800 00000020:00000080:2.0:1788863837.843000:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863837.843022:0:17805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863837.843025:0:17805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863837.843027:0:17805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788863837.843029:0:17805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788863837.843348:0:17792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788863837.843372:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863837.843393:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.843405:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863837.843465:0:17792:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788863837.843468:0:17792:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e5425c9800 10000000:01000000:0.0:1788863837.843471:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e5425c9800 10000000:01000000:0.0:1788863837.843475:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863837.843481:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e5425c9800 from 1 10000000:01000000:0.0:1788863837.843483:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863837.843514:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.843521:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.843530:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863837.843558:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788863837.843611:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863837.843645:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601344 00000100:00100000:0.0:1788863837.843651:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601344 00000100:00100000:0.0:1788863837.843687:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788863837.843694:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17792:x1875759226601344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863837.843705:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863837.843718:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64259ac00/0xf569beb9d4b69fec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b69fe5 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.843738:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259ac00/0xf569beb9d4b69fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b69fe5 expref: 18 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.843749:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64259ac00/0xf569beb9d4b69fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69fe5 expref: 18 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.843757:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259ac00, rc 0) 00000100:00100000:0.0:1788863837.843787:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601344:12345-0@lo:101:mount.lustre.0 Request processed in 94us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.843794:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788863837.843852:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.843870:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863837.843883:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.843891:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863837.854520:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788863837.854832:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863837.855025:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788863837.855048:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788863837.855358:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788863837.855374:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788863837.855387:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788863837.855399:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788863837.855412:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788863837.855424:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788863837.855437:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788863837.855450:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788863837.855463:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788863837.855476:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788863837.855489:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788863837.855519:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788863837.855533:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788863837.855544:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788863837.855561:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788863837.855575:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788863837.855587:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788863837.855598:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788863837.855610:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788863837.855621:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788863837.855633:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788863837.855644:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788863837.855656:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788863837.855668:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788863837.855679:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788863837.855690:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788863837.855708:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788863837.855720:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788863837.855806:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863837.856994:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863837.857043:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601472 00000100:00100000:0.0:1788863837.857937:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601472 00000100:00100000:0.0:1788863837.857997:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863837.858006:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863837.859257:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601472:12345-0@lo:501:mount.lustre.0 Request processed in 1247us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.859389:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863837.859467:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.859492:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863837.859546:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863837.859595:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863837.859623:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65087a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.860121:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601600 00000100:00100000:1.0:1788863837.860131:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601600 00000100:00100000:1.0:1788863837.860173:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788863837.860181:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863837.860297:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601600:12345-0@lo:503:mount.lustre.0 Request processed in 115us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863837.860310:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863837.861093:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788863837.861572:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788863837.861715:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863837.861771:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863837.861807:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.861990:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601728 00000100:00100000:0.0:1788863837.861997:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601728 00000100:00100000:0.0:1788863837.862041:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788863837.862050:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863837.862223:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601728:12345-0@lo:502:mount.lustre.0 Request processed in 174us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.862231:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863837.863161:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788863837.863357:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788863837.863382:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788863837.863393:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788863837.863404:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788863837.863414:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788863837.863424:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788863837.863434:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788863837.863461:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788863837.863472:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788863837.863482:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788863837.863493:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788863837.863503:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788863837.863513:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788863837.863523:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788863837.863533:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788863837.863544:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788863837.863565:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788863837.863577:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788863837.863587:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788863837.863598:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788863837.863608:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788863837.863618:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788863837.863628:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788863837.863638:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788863837.863648:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788863837.863658:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788863837.863668:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788863837.863678:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788863837.863689:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788863837.863699:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788863837.863709:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788863837.863719:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788863837.863739:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788863837.863750:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788863837.863760:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788863837.863771:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788863837.863781:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788863837.863791:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788863837.863802:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788863837.865316:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788863837.865384:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788863837.865398:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788863837.865409:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788863837.865422:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788863837.865433:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788863837.865444:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788863837.865456:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788863837.865468:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788863837.865545:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863837.865612:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863837.865660:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.866179:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601856 00000100:00100000:0.0:1788863837.866187:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601856 00000100:00100000:0.0:1788863837.866227:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863837.866236:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863837.866350:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601856:12345-0@lo:502:mount.lustre.0 Request processed in 115us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.866358:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863837.867384:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788863837.867564:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788863837.867586:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788863837.867613:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863837.867656:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863837.867697:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.868901:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226601984 00000100:00100000:0.0:1788863837.868914:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226601984 00000100:00100000:0.0:1788863837.868974:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788863837.868982:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863837.871429:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226601984:12345-0@lo:502:mount.lustre.0 Request processed in 2439us (3764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.871445:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863837.871905:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226601984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788863837.872011:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788863837.872026:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788863837.873239:0:17810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788863837.873256:0:17810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff89e6763c4d40) 00000020:00000080:1.0:1788863837.873279:0:17810:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788863837.873370:0:17810:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5425c9800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788863837.873375:0:17810:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5425c9800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788863837.873377:0:17810:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5425c9800 3 00010000:00080000:1.0:1788863837.873409:0:17810:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e676192800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788863837.883788:0:17810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788863837.884689:0:17810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788863837.884733:0:17810:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788863837.884746:0:17810:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf569beb9d4b69ffa 00000100:00080000:1.0:1788863837.884756:0:17810:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863837.884779:0:17810:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89e676192800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863837.884826:0:17810:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4ba680 x1875759226602112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863837.884858:0:17810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788863837.885115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226602112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788863837.885192:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863837.885846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788863837.885851:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788863837.885854:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863837.885865:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e671be9000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863837.885882:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4bb100 x1875759226602368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863837.885894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863837.885897:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863837.885907:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863837.885910:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863837.885952:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863837.885956:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863837.885958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863837.885961:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863837.885980:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226602496:0@lo:400:kworker.0 00000100:00100000:1.0:1788863837.886014:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863837.886043:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226602624:0@lo:400:kworker.0 00000100:00100000:1.0:1788863837.886066:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863837.886147:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226602368:0@lo:38:kworker.0 00000100:00100000:2.0:1788863837.886174:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226602240:0@lo:400:kworker.0 00000100:00100000:3.0:1788863837.886182:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.886224:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863837.886341:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226602624 00000100:00100000:0.0:1788863837.886348:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226602624 00000100:00100000:0.0:1788863837.886381:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226602368 00000100:00100000:0.0:1788863837.886385:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226602368 00000100:00100000:0.0:1788863837.886397:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863837.886407:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875759226602624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863837.886457:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875759226602624:12345-0@lo:400:kworker.0 Request processed in 52us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.886464:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863837.886479:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863837.886484:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226602368:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788863837.886519:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226602368:12345-0@lo:38:kworker.0 Request processed in 34us (341us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788863837.886525:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788863837.888376:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863837.888387:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788863837.888392:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226602368:0@lo:38:kworker.0 00000100:00100000:3.0:1788863837.888456:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226602112 00000100:00100000:3.0:1788863837.888462:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226602112 00000100:00100000:3.0:1788863837.888499:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226602496 00000100:00100000:3.0:1788863837.888503:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226602496 00000100:00100000:3.0:1788863837.888530:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863837.888538:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226602496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863837.888604:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226602496:12345-0@lo:400:kworker.0 Request processed in 67us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863837.888611:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863837.888630:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863837.888635:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226602112:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788863837.888657:0:17062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1788863837.888701:0:17062:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf569beb9d4b6a001 00000004:00100000:3.0:1788863837.888716:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788863837.888749:0:17062:0:(import.c:65:import_set_state_nolock()) ffff89e67b77f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863837.888795:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875759226602112:12345-0@lo:38:llog_process_th.0 Request processed in 159us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863837.888801:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788863837.888831:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e66d4ba680 x1875759226602112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863837.888840:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863837.888846:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788863837.888853:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788863837.888857:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788863837.888860:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788863837.888864:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226602112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788863837.889006:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226602240 00000100:00100000:2.0:1788863837.889012:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226602240 00000100:00100000:2.0:1788863837.889047:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788863837.889571:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226602624:0@lo:400:kworker.0 00010000:00080000:1.0:1788863837.889641:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e66d4b9500 x1875759226602496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863837.889652:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226602496:0@lo:400:kworker.0 00000100:00100000:2.0:1788863837.890324:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3641:x1875759226602240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863837.890438:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3641:x1875759226602240:12345-0@lo:400:kworker.0 Request processed in 1383us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.890446:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000040:00080000:3.0:1788863837.898154:0:17810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788863837.898303:0:17792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788863837.898351:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788863837.898377:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863837.898391:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788863837.898455:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788863837.898458:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788863837.898460:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863837.898462:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863837.898463:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863837.898466:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863837.898467:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863837.898470:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863837.898472:0:17792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788863837.898476:0:17792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788863837.898479:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788863837.898481:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788863837.898483:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863837.898485:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863837.898486:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863837.898488:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863837.898489:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863837.898491:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863837.898493:0:17792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788863837.898537:0:17792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788863837.898559:0:17792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226602752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788863837.898646:0:17792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863837.898716:0:17792:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863837.899503:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226602752 00000100:00100000:0.0:1788863837.899513:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226602752 00000100:00100000:0.0:1788863837.899569:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788863837.899590:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226602752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863837.899621:0:17053:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788863837.899635:0:17053:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788863837.900231:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226602240:0@lo:400:kworker.0 00000001:00100000:1.0:1788863837.904464:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788863837.904530:0:17053:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788863837.904573:0:17053:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788863837.904854:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17792:x1875759226602752:12345-0@lo:253:mount.lustre.0 Request processed in 5261us (6206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863837.904872:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:1.0:1788863837.904973:0:17076:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788863837.904978:0:17076:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788863837.904999:0:17076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.905014:0:17076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.905029:0:17076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.905036:0:17076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.905071:0:17076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863837.905269:0:17076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 17 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863837.905283:0:17076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226602880:0@lo:104: 00000100:00100000:3.0:1788863837.905466:0:17792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:17792:1875759226602752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788863837.905477:0:17792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788863837.905485:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788863837.905487:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788863837.905489:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863837.905490:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863837.905492:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863837.905493:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863837.905494:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863837.905496:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863837.905497:0:17792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788863837.905509:0:17792:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788863837.908514:0:17076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863837.908589:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226602880 00000100:00100000:0.0:1788863837.908598:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226602880 00010000:00010000:2.0:1788863837.908614:0:17076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908630:0:17076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 17 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863837.908642:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863837.908643:0:17076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226603008:0@lo:104: 00000100:00100000:0.0:1788863837.908649:0:17044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226602880:12345-0@lo:104: 00010000:00010000:0.0:1788863837.908661:0:17044:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863837.908668:0:17076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.908677:0:17076:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015b000 going to sleep for 11 seconds 00010000:00010000:0.0:1788863837.908716:0:17044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863837.908722:0:17044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226602880:12345-0@lo:104: Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.908729:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863837.908741:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603008 00000100:00100000:0.0:1788863837.908744:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603008 00000100:00100000:0.0:1788863837.908755:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863837.908758:0:17076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226602880:0@lo:104: 00000100:00100000:0.0:1788863837.908760:0:17044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226603008:12345-0@lo:104: 00010000:00010000:0.0:1788863837.908767:0:17044:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908769:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863837.908774:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908780:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863837.908785:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908794:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.908797:0:17044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1788863837.908802:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863837.908802:0:17044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226603008:12345-0@lo:104: Request processed in 42us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.908808:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:2.0:1788863837.908809:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863837.908834:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908855:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788863837.908910:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226603136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863837.908964:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863837.908971:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908978:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b69fc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69fd0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908989:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788863837.908992:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603136 00010000:00010000:2.0:1788863837.908993:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.908998:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc147ac20) 00000100:00100000:0.0:1788863837.909000:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603136 10000000:00010000:2.0:1788863837.909001:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.909008:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863837.909014:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909015:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 18 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863837.909019:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863837.909033:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863837.909036:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788863837.909039:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788863837.909042:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3640:x1875759226603136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863837.909048:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909052:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863837.909054:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b69f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69f0c expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909056:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 18 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909066:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 18 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.909072:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863837.909074:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863837.909094:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863837.909099:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863837.909113:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863837.909121:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226603264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863837.909145:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.909172:0:17047:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788863837.909180:0:17047:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788863837.909270:0:17076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226603008:0@lo:104: 00010000:00010000:0.0:1788863837.909442:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650923a00/0xf569beb9d4b69fd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b69fc9 expref: 18 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.909443:0:17076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909455:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863837.909483:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:3640:x1875759226603136:12345-0@lo:103:ldlm_bl.0 Request processed in 441us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.909489:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863837.909501:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603264 00000100:00100000:0.0:1788863837.909504:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603264 00010000:00010000:0.0:1788863837.909515:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 17 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863837.909527:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863837.909532:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:3640:x1875759226603264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863837.909540:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863837.909544:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 17 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909562:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 17 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909573:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641536000/0xf569beb9d4b69f0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b69f05 expref: 17 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909584:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909592:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788863837.909605:0:17045:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004627317s 00010000:00010000:0.0:1788863837.909609:0:17045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909615:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909622:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909629:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909634:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f600 already unused, calling callback (ffffffffc0e79930) 00000100:00100000:1.0:1788863837.909635:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226603136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863837.909639:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909646:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.909994:0:17076:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.909994:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863837.910004:0:17076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863837.910006:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863837.910010:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a008 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863837.913428:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:3640:x1875759226603264:12345-0@lo:103:ldlm_bl.0 Request processed in 3887us (4275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.913442:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863837.913496:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226603264:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1788863837.913980:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788863837.914118:0:17817:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788863837.914122:0:17817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788863837.914380:0:17818:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788863837.914744:0:17818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788863837.916419:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788863837.918109:0:17818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788863837.918203:0:17818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788863837.918596:0:17819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875759226603392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788863837.918676:0:17819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.918711:0:17819:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97e40 going to sleep for 11 seconds 00000040:01000000:3.0:1788863837.918914:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1788863837.918964:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603392 00000100:00100000:0.0:1788863837.918972:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603392 00000040:00080000:3.0:1788863837.918974:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863837.919019:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863837.919027:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17819:x1875759226603392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788863837.919137:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17819:x1875759226603392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.919144:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863837.919197:0:17819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875759226603392:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788863837.919226:0:17819:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788863837.919260:0:17819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875759226603520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788863837.919289:0:17819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.919312:0:17819:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.919355:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603520 00000100:00100000:1.0:1788863837.919359:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603520 00000100:00100000:1.0:1788863837.919391:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863837.919398:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17819:x1875759226603520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788863837.919501:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17819:x1875759226603520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863837.919508:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863837.919567:0:17819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875759226603520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788863837.919613:0:17819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17819:1875759226603648:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788863837.919639:0:17819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.919662:0:17819:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.919717:0:17071:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603648 00000100:00100000:1.0:1788863837.919722:0:17071:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603648 00000100:00100000:1.0:1788863837.919763:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863837.919769:0:17071:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17819:x1875759226603648:12345-0@lo:900:lod0001_rec0000.0 00010000:00080000:2.0:1788863837.919899:0:17819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e543b78a80 x1875759226603648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788863853 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863837.919911:0:17819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17819:1875759226603648:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788863837.919955:0:17819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875759226603776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788863837.919980:0:17819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863837.920001:0:17819:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863837.920029:0:17071:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17819:x1875759226603648:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863837.920037:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863837.920052:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603776 00000100:00100000:0.0:1788863837.920057:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603776 00000100:00100000:0.0:1788863837.920121:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863837.920127:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17819:x1875759226603776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788863837.920204:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17819:x1875759226603776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863837.920210:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00000080:3.0:1788863837.920491:0:17792:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788863837.920501:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788863837.920562:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863837.920699:0:17819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875759226603776:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788863837.920738:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788863837.924247:0:17792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788863837.925285:0:17819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788863837.925349:0:17819:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788863837.925355:0:17819:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1788863837.925652:0:17792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788863837.925699:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788863837.925972:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788863837.926593:0:17792:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1788863837.928380:0:17792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788863837.933854:0:17792:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788863837.933900:0:17792:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa4a9c15d3988 00100000:10000000:3.0:1788863837.933909:0:17792:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788863837.936051:0:17792:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788863837.936775:0:17792:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788863837.936797:0:17792:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788863837.936946:0:17792:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788863837.938732:0:17792:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788863837.939552:0:17792:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863838.449538:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863838.827216:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000040:00080000:2.0:1788863838.955941:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788863839.083200:0:17058:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863839.083209:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5425c9800 from 8 10000000:01000000:2.0:1788863839.083213:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863839.083278:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863839.083290:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863839.083322:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863839.083348:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226603904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863839.083413:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863839.083501:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863839.084314:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226603904 00000100:00100000:0.0:1788863839.084333:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226603904 00000100:00100000:0.0:1788863839.084387:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788863839.084397:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:17058:x1875759226603904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863839.084411:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863839.084427:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a00f expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863839.084453:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863839.084465:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863839.084474:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259aa00, rc 0) 00000100:00100000:0.0:1788863839.084787:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226603904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 391us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863839.084795:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863839.085019:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226603904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863839.085035:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863839.085045:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863839.085157:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226604032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788863839.085376:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863839.085460:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863839.087431:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604032 00000100:00100000:0.0:1788863839.087445:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604032 00000100:00100000:0.0:1788863839.087509:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788863839.087518:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226604032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788863839.087540:0:17053:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788863839.087560:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788863839.087563:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788863839.087695:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226604032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863839.087704:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788863839.087979:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226604032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788863839.088040:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863839.088049:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863839.088061:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863839.088099:0:17058:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863839.088103:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5448c2800 from 8 10000000:01000000:2.0:1788863839.088111:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863839.088653:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863839.088664:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863839.088674:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863839.088697:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226604160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863839.088741:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863839.088933:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863839.089008:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604160 00000100:00100000:0.0:1788863839.089014:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604160 00000100:00100000:0.0:1788863839.089284:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788863839.089294:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226604160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863839.089306:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863839.089320:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a01d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863839.089342:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863839.089353:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863839.089360:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259be00, rc 0) 00000100:00100000:0.0:1788863839.089463:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226604160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863839.089470:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863839.090356:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226604160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863839.090375:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863839.090400:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863839.090466:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226604288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788863839.090507:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863839.090550:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b63bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863839.090623:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604288 00000100:00100000:2.0:1788863839.090629:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604288 00000100:00100000:2.0:1788863839.090685:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788863839.090693:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226604288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788863839.090706:0:17054:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788863839.090721:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788863839.090724:0:17054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788863839.090818:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226604288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863839.090825:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863839.091321:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226604288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788863839.091369:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788863839.091376:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863839.091385:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863839.467421:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863839.852165:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000040:00080000:0.0:1788863839.982906:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863840.491303:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863840.875140:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00010000:00010000:1.0:1788863841.515696:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863841.907270:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000001:02000400:3.0:1788863841.920937:0:18062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788863842.540967:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863842.925344:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 0 seconds 00000020:00000004:1.0:1788863842.926809:0:18114:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863842.927017:0:18114:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1788863843.309640:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788863843.309647:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788863843.309651:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863843.309667:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e671be9000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863843.309701:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dce00 x1875759226604544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863843.309729:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863843.309733:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863843.309736:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863843.309753:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863843.309784:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863843.309788:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863843.309790:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863843.309792:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863843.309845:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226604544:0@lo:38:kworker.0 00000100:00100000:3.0:1788863843.310439:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226604800:0@lo:400:kworker.0 00000100:00100000:1.0:1788863843.312462:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226604416:0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.317476:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863843.317554:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863843.317567:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226604928:0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.317621:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863843.317661:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604928 00000100:00100000:3.0:1788863843.317668:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604928 00000100:00100000:3.0:1788863843.317715:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863843.317723:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226604928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.318232:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226604928:12345-0@lo:400:kworker.0 Request processed in 509us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863843.318248:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788863843.318293:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dca80 x1875759226604928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863843.318308:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226604928:0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.318359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226604672:0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.318387:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863843.318449:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604672 00000100:00100000:3.0:1788863843.318453:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604672 00000100:00100000:3.0:1788863843.318477:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863843.318483:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226604672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.318518:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226604672:12345-0@lo:400:kworker.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863843.318523:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863843.318913:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604800 00000100:00100000:3.0:1788863843.318918:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604800 00000100:00100000:3.0:1788863843.318951:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863843.318958:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226604800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.319336:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226604800:12345-0@lo:400:kworker.0 Request processed in 379us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863843.319343:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788863843.319377:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dd880 x1875759226604672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863843.319388:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226604672:0@lo:400:kworker.0 00000100:00100000:3.0:1788863843.319418:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226604800:0@lo:400:kworker.0 00000100:00100000:0.0:1788863843.323933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863843.324104:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604544 00000100:00100000:3.0:1788863843.324114:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604544 00000100:00100000:3.0:1788863843.324163:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863843.324171:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226604544:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788863843.324215:0:17065:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1788863843.324461:0:17065:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a02b 00000004:00100000:3.0:1788863843.324478:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788863843.324484:0:17065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788863843.326486:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863843.327758:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226605056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863843.327825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863843.328371:0:17066:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788863843.328382:0:17066:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788863843.333453:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605056 00000100:00100000:3.0:1788863843.333469:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605056 00000100:00100000:1.0:1788863843.334227:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863843.334365:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226605056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863843.334405:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788863843.334481:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226605056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 246us (6668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863843.334488:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788863843.334647:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226605056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863843.335972:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226604416 00000100:00100000:0.0:1788863843.335983:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226604416 00000100:00100000:0.0:1788863843.336070:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863843.336097:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3642:x1875759226604416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863843.336173:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3642:x1875759226604416:12345-0@lo:400:kworker.0 Request processed in 77us (9692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863843.336179:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788863843.336267:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226604416:0@lo:400:kworker.0 00000100:00080000:3.0:1788863843.345871:0:17065:0:(import.c:65:import_set_state_nolock()) ffff89e676d88000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863843.346410:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226604544:12345-0@lo:38:kworker.0 Request processed in 22234us (22480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863843.346421:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788863843.346992:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788863843.347002:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788863843.347008:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788863843.347011:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788863843.347029:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000af5936b2): req@ffff89e66d4b9180 x1875759226597120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863843.352172:0:17102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863843.352221:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e658790000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863843.352604:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226597120 00000100:00100000:2.0:1788863843.352613:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226597120 00000100:00100000:2.0:1788863843.352667:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863843.352677:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17102:x1875759226597120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788863843.352800:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17102:x1875759226597120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 125us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863843.352808:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788863843.352898:0:17102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17102:1875759226597120:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788863843.352941:0:17102:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788863843.352995:0:17102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17102:1875759226605184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788863843.353027:0:17102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863843.353062:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649af5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863843.353101:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605184 00000100:00100000:1.0:1788863843.353105:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605184 00000100:00100000:1.0:1788863843.353133:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863843.353139:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17102:x1875759226605184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788863843.353245:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17102:x1875759226605184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863843.353252:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863843.353274:0:17102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17102:1875759226605184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788863843.353335:0:17102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17102:1875759226605312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788863843.353355:0:17102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863843.353369:0:17102:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649af5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863843.353380:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605312 00000100:00100000:1.0:1788863843.353383:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605312 00000100:00100000:1.0:1788863843.353400:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788863843.353406:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17102:x1875759226605312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788863843.353463:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17102:x1875759226605312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863843.353469:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788863843.353493:0:17102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17102:1875759226605312:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788863843.353526:0:17102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788863843.354278:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863843.354289:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226605440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863843.354323:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863843.354351:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605440 00000100:00100000:3.0:1788863843.354355:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605440 00000100:00100000:3.0:1788863843.354441:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863843.354448:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226605440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863843.354470:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788863843.354502:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226605440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863843.354519:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863843.354551:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226605440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863843.354647:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226604544:0@lo:38:kworker.0 00000040:00080000:1.0:1788863843.355521:0:17102:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788863843.355600:0:17102:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1788863843.355605:0:17102:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788863843.563399:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788863844.241682:0:18165:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788863844.242503:0:18165:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788863844.587637:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863845.616574:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863845.937167:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788863845.995965:0:18214:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5b1fdf50 20000000:00000080:0.0:1788863845.995990:0:18214:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e67b78c800 uarg=0000000000000000 20000000:01000000:0.0:1788863845.996042:0:18214:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788863846.000940:0:18214:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788863846.000953:0:18214:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788863846.002200:0:18215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788863846.002824:0:18214:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788863846.018938:0:18214:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788863846.019156:0:18214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.019183:0:18214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.019192:0:18214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.019200:0:18214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.019256:0:18214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.019275:0:18214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 17 pid: 17055 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863846.019293:0:18214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18214:1875759226605568:0@lo:104: 00000100:00100000:1.0:1788863846.019378:0:18214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863846.019448:0:18214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.019456:0:18214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 17 pid: 17053 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863846.019463:0:18214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18214:1875759226605696:0@lo:104: 00000100:00100000:1.0:1788863846.019502:0:18214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863846.019521:0:18214:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788863846.019603:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605568 00000100:00100000:2.0:1788863846.019613:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605568 00000100:00100000:2.0:1788863846.019659:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605696 00000100:00100000:2.0:1788863846.019661:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605696 00000100:00100000:2.0:1788863846.019677:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863846.019686:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:18214:x1875759226605568:12345-0@lo:104: 00010000:00010000:2.0:1788863846.019710:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.019790:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863846.019796:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:18214:x1875759226605568:12345-0@lo:104: Request processed in 111us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863846.019804:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863846.019828:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863846.019834:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:18214:x1875759226605696:12345-0@lo:104: 00010000:00010000:2.0:1788863846.019843:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.019878:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788863846.019883:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:18214:x1875759226605696:12345-0@lo:104: Request processed in 51us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863846.019890:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788863846.019911:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863846.019918:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.019934:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863846.019939:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.019947:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863846.019954:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863846.019960:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788863846.019999:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020006:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863846.020038:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020046:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3ea00/0xf569beb9d4b69fd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69fde expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020059:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863846.020062:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020067:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863846.020070:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020117:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863846.020124:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863846.020130:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788863846.020145:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020152:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863846.020160:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020168:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537200/0xf569beb9d4b69ed4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b69edb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.020183:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863846.020185:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863846.020186:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863846.020194:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863846.020206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226605952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863846.020237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863846.020270:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863846.020277:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226605824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863846.020299:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863846.022649:0:18214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18214:1875759226605568:0@lo:104: 00000100:00100000:1.0:1788863846.022669:0:18214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18214:1875759226605696:0@lo:104: 00010000:00010000:1.0:1788863846.022709:0:18214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863846.031032:0:17814:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605952 00000100:00100000:3.0:1788863846.031055:0:17814:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605952 00010000:00010000:3.0:1788863846.031141:0:17814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 18 pid: 17053 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863846.031778:0:17814:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226605824 00000100:00100000:3.0:1788863846.031784:0:17814:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226605824 00010000:00010000:3.0:1788863846.031809:0:17814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 19 pid: 17055 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863846.031861:0:17814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863846.031870:0:17814:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3641:x1875759226605952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863846.031889:0:17814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863846.031895:0:17814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 19 pid: 17053 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863846.031909:0:17814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 19 pid: 17053 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863846.031932:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98800/0xf569beb9d4b69edb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b69ed4 expref: 19 pid: 17053 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863846.031953:0:17814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863846.031980:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863846.031994:0:17047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3641:x1875759226605824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863846.032005:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863846.032011:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 18 pid: 17055 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032024:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 18 pid: 17055 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032036:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b69fde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b69fd7 expref: 18 pid: 17055 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032052:0:17047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032062:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863846.032103:0:17814:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:3641:x1875759226605952:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (11864us total) trans 0 rc 0/0 00010000:00010000:1.0:1788863846.032108:0:17047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863846.032115:0:17814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788863846.032123:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032143:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032151:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032159:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863846.032164:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032173:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032198:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.032212:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863846.032243:0:17047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:3641:x1875759226605824:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (11944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863846.032250:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788863846.033175:0:18214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863846.033189:0:18214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863846.033206:0:18214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6a032 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863846.033883:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226605824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863846.033902:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226605952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863846.639357:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863847.434286:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863837/real 1788863837] req@ffff89e5440c2300 x1875759226600320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863847 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863847.434324:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5440c2300 x1875759226600320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863847 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863847.434337:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863837/real 1788863837] req@ffff89e543b79880 x1875759226600064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863847 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863847.434348:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543b79880 x1875759226600064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863847 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788863847.434370:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863847.434405:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788863847.434409:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226600320:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788863847.434416:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544175800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863847.434422:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788863847.434424:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226600064:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788863847.434694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863847.434699:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788863847.434703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863847.434706:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788863847.434732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863847.434745:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788863847.434749:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544175800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863847.434755:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1788863847.434761:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788863847.434776:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89e544175800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863847.434800:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5440c1f80 x1875759226606592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863847.434817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863847.434820:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788863847.434834:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863847.434838:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1788863847.434841:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788863847.434847:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e67b6ae000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863847.434859:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5440c2680 x1875759226606720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788863847.434891:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226606592:0@lo:8:kworker.0 00000400:00000100:3.0:1788863847.434954:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226606592 offset 0 length 520: 4 00000100:00100000:3.0:1788863847.435007:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226606720:0@lo:8:kworker.0 00000400:00000100:3.0:1788863847.435031:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226606720 offset 0 length 520: 4 00000100:00100000:0.0:1788863847.435179:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226606208:0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435222:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.435246:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788863847.435251:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226606080:0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.435292:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226606848:0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.435340:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226606336:0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.435380:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863847.435384:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226606464:0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.435434:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226606080 00000100:00100000:0.0:1788863847.435443:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226606080 00000100:00100000:0.0:1788863847.435495:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863847.435504:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:3643:x1875759226606080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435562:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:3643:x1875759226606080:12345-0@lo:400:kworker.0 Request processed in 59us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.435570:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863847.435605:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226606208 00000100:00100000:0.0:1788863847.435609:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226606208 00000100:00100000:0.0:1788863847.435643:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226606464 00000100:00100000:0.0:1788863847.435646:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226606464 00000100:00100000:0.0:1788863847.435673:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863847.435678:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226606208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435715:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226606208:12345-0@lo:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.435720:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863847.435730:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863847.435751:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226606464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435779:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226606464:12345-0@lo:400:kworker.0 Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.435784:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863847.435815:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226606464:0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435835:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226606080:0@lo:400:kworker.0 00000100:00100000:0.0:1788863847.435843:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226606208:0@lo:400:kworker.0 00000100:00100000:3.0:1788863847.436807:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226606848 00000100:00100000:3.0:1788863847.436818:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226606848 00000100:00100000:3.0:1788863847.436869:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226606336 00000100:00100000:3.0:1788863847.436873:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226606336 00000100:00100000:3.0:1788863847.436890:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863847.436898:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226606848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863847.436968:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226606848:12345-0@lo:400:kworker.0 Request processed in 71us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863847.436974:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863847.436989:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788863847.436994:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226606336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863847.437024:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226606336:12345-0@lo:400:kworker.0 Request processed in 30us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863847.437029:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788863847.437071:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5440c3480 x1875759226606336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863847.437130:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226606336:0@lo:400:kworker.0 00010000:00080000:3.0:1788863847.437165:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5440c3100 x1875759226606848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863847.437174:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226606848:0@lo:400:kworker.0 00010000:00010000:2.0:1788863847.665260:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788863847.788266:0:17058:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863847.788282:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5425c9800 from 13 10000000:01000000:3.0:1788863847.788290:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863847.788354:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863847.788369:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863847.788394:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863847.788441:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226606976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863847.788536:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863847.788606:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6587ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863847.789236:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226606976 00000100:00100000:0.0:1788863847.789247:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226606976 00000100:00100000:0.0:1788863847.789352:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788863847.789363:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+16:17058:x1875759226606976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863847.789392:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863847.789413:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a039 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.789451:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.789464:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.789488:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a400, rc 0) 00000100:00100000:0.0:1788863847.789558:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226606976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.789565:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788863847.790396:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226606976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863847.790420:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863847.790443:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863847.790542:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863847.790606:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863847.793139:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6587ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863847.793214:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226607104 00000100:00100000:0.0:1788863847.793228:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226607104 00000100:00100000:0.0:1788863847.793295:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788863847.793307:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226607104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.793527:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226607104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (2920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.793541:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863847.793823:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863847.793902:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863847.793960:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863847.794106:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6587ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863847.794371:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226607232 00000100:00100000:0.0:1788863847.794378:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226607232 00000100:00100000:0.0:1788863847.794435:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788863847.794444:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226607232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.794550:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226607232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.794557:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863847.794652:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788863847.800933:0:18278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788863847.801211:0:17058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788863847.801245:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863847.801260:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.801275:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863847.801313:0:17058:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863847.801316:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5448c2800 from 13 10000000:01000000:0.0:1788863847.801319:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863847.801420:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.801428:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.801441:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863847.801474:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.801561:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.801881:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886480 going to sleep for 11 seconds 00000100:00100000:1.0:1788863847.807752:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226607360 00000100:00100000:1.0:1788863847.807777:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226607360 00000100:00100000:1.0:1788863847.807859:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788863847.807872:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+17:17058:x1875759226607360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863847.807897:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863847.807921:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a047 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863847.807960:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863847.807983:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863847.807995:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e400, rc 0) 00000100:00100000:1.0:1788863847.808117:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226607360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (6554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863847.808125:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788863847.808150:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863847.808176:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.808188:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863847.808291:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.808335:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.808389:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886480 going to sleep for 11 seconds 00000100:00100000:0.0:1788863847.808408:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226607488 00000100:00100000:0.0:1788863847.808705:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226607488 00000100:00100000:0.0:1788863847.808760:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788863847.808768:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226607488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.808899:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226607488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.808920:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788863847.808961:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.808995:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.809034:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863847.809047:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886480 going to sleep for 11 seconds 00000100:00100000:0.0:1788863847.809057:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226607616 00000100:00100000:0.0:1788863847.809060:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226607616 00000100:00100000:0.0:1788863847.809099:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863847.809104:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226607616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863847.809178:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:17058:x1875759226607616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863847.809185:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863847.809221:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226607616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788863847.822640:0:18279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788863847.823309:0:17058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788863847.823342:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863847.823357:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863847.823372:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863848.427595:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863848.427631:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226607744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863848.427701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863848.428127:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863848.428274:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226607872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863848.428311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863848.428344:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226607744 00000100:00100000:2.0:1788863848.428352:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226607744 00000100:00100000:2.0:1788863848.428411:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226607872 00000100:00100000:2.0:1788863848.428415:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226607872 00000100:00100000:2.0:1788863848.428431:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788863848.428439:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226607744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863848.428476:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788863848.428524:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226607744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863848.428532:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788863848.428547:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788863848.428553:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226607872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863848.428570:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788863848.429420:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226607872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863848.429466:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226607744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863848.430255:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226607872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863848.430266:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788863848.493858:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863833/real 1788863833] req@ffff89e543b79c00 x1875759226598144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863848.493891:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543b79c00 x1875759226598144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863848.493903:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863833/real 1788863833] req@ffff89e543b79180 x1875759226598272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863848.493914:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543b79180 x1875759226598272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788863848.493935:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863848.504931:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788863848.504945:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226598144:0@lo:8:kworker.0 00000100:00080000:2.0:1788863848.504974:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863848.504985:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788863848.504988:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226598272:0@lo:8:kworker.0 00000100:00080000:0.0:1788863848.511136:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863848.511144:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788863848.511148:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863848.511157:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1788863848.511164:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788863848.511176:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e5425b0800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863848.511201:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438ded80 x1875759226608128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863848.511228:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863848.511231:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863848.511233:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863848.511237:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1788863848.511239:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788863848.511244:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e676341000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863848.511256:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438ddf80 x1875759226608256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863848.511282:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863848.511287:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863848.511289:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863848.511292:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863848.511325:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226608384:0@lo:400:kworker.0 00000100:00100000:0.0:1788863848.511408:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863848.511444:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863848.511449:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226608512:0@lo:400:kworker.0 00000100:00100000:0.0:1788863848.511470:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863848.511511:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226608128:0@lo:8:kworker.0 00000400:00000100:0.0:1788863848.511536:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226608128 offset 0 length 520: 4 00000100:00100000:0.0:1788863848.511565:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226608256:0@lo:8:kworker.0 00000400:00000100:0.0:1788863848.511583:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226608256 offset 0 length 520: 4 00000100:00100000:3.0:1788863848.511828:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863848.511840:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226608000:0@lo:400:kworker.0 00000100:00100000:3.0:1788863848.511879:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863848.511916:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226608384 00000100:00100000:3.0:1788863848.511925:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226608384 00000100:00100000:3.0:1788863848.511980:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226608512 00000100:00100000:3.0:1788863848.511983:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226608512 00000100:00100000:3.0:1788863848.511999:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788863848.512006:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226608384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863848.512057:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226608384:12345-0@lo:400:kworker.0 Request processed in 51us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863848.512064:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788863848.512099:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863848.512106:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226608512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863848.512131:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226608512:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863848.512146:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863848.512175:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226608000 00000100:00100000:3.0:1788863848.512178:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226608000 00000100:00100000:3.0:1788863848.512202:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788863848.512208:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3640:x1875759226608000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863848.512253:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3640:x1875759226608000:12345-0@lo:400:kworker.0 Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863848.512260:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788863848.514347:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dc000 x1875759226608512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863848.514365:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226608512:0@lo:400:kworker.0 00010000:00080000:2.0:1788863848.514378:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dea00 x1875759226608384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863848.514387:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226608384:0@lo:400:kworker.0 00000100:00100000:2.0:1788863848.514448:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226608000:0@lo:400:kworker.0 00010000:00010000:2.0:1788863848.684842:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788863848.946567:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1788863849.195764:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788863849.707604:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863850.731804:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863851.760892:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863852.779618:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863853.547305:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226608640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863853.547375:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863853.547824:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863853.547828:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863853.547831:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863853.547833:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863853.547845:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863853.547847:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863853.547850:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863853.547853:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863853.547873:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226608768:0@lo:400:kworker.0 00000100:00100000:1.0:1788863853.547929:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863853.547958:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863853.547964:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226609152:0@lo:400:kworker.0 00000100:00100000:1.0:1788863853.548007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863853.548033:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226609024:0@lo:400:kworker.0 00000100:00100000:1.0:1788863853.548057:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863853.548072:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863853.548098:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226608896:0@lo:400:kworker.0 00000100:00100000:1.0:1788863853.548140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863853.548167:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226608768 00000100:00100000:1.0:1788863853.548175:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226608768 00000100:00100000:1.0:1788863853.548219:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788863853.548227:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3641:x1875759226608768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863853.548274:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:3641:x1875759226608768:12345-0@lo:400:kworker.0 Request processed in 48us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863853.548281:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788863853.548324:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226608768:0@lo:400:kworker.0 00000100:00100000:0.0:1788863853.548565:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226608640 00000100:00100000:0.0:1788863853.548570:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226608640 00000100:00100000:0.0:1788863853.548596:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226608896 00000100:00100000:0.0:1788863853.548599:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226608896 00000100:00100000:0.0:1788863853.548622:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863853.548630:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226608640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863853.548659:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788863853.548706:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226608640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863853.548712:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863853.548724:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863853.548732:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226608896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863853.548761:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226608896:12345-0@lo:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863853.548767:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863853.548934:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609152 00000100:00100000:3.0:1788863853.548939:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609152 00000100:00100000:3.0:1788863853.548971:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609024 00000100:00100000:3.0:1788863853.548974:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609024 00000100:00100000:3.0:1788863853.548987:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863853.548993:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226609152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863853.549026:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226609152:12345-0@lo:400:kworker.0 Request processed in 34us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863853.549031:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863853.549041:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863853.549047:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226609024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863853.549070:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226609024:12345-0@lo:400:kworker.0 Request processed in 24us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863853.549108:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788863853.549316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226608896:0@lo:400:kworker.0 00010000:00080000:1.0:1788863853.549329:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e66d4b8380 x1875759226609024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863853.549338:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226609024:0@lo:400:kworker.0 00000100:00100000:1.0:1788863853.549368:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226608640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863853.549381:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863853.549387:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226609280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863853.549413:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788863853.549546:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e66d4ba680 x1875759226609152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863853.549575:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226609152:0@lo:400:kworker.0 00000100:00100000:3.0:1788863853.549635:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609280 00000100:00100000:3.0:1788863853.549640:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609280 00000100:00100000:3.0:1788863853.549670:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863853.549678:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226609280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863853.549707:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788863853.549744:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226609280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863853.549750:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788863853.549854:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226609280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788863853.807232:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788863854.035244:0:18563:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788863854.035248:0:18563:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788863854.035250:0:18563:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788863854.035360:0:18563:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e67b71c000 00000020:01000004:0.0:1788863854.035393:0:18563:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788863854.035407:0:18563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788863854.035422:0:18563:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89e66c64cd40) 00000020:00000080:0.0:1788863854.035792:0:18563:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788863854.146442:0:18563:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788863854.149742:0:18563:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788863854.151550:0:18563:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788863854.151897:0:18563:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788863854.152149:0:18563:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788863854.152325:0:18563:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788863854.153891:0:18563:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788863854.163702:0:18563:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788863854.163919:0:18563:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788863854.163932:0:18563:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788863854.163945:0:18563:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf569beb9d4b6a05c 00000020:01000004:2.0:1788863854.163951:0:18563:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788863854.164001:0:18563:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788863854.164004:0:18563:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788863854.164011:0:18563:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788863854.164016:0:18563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788863854.164027:0:18563:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89e67b6c4d40) 00000020:00000080:2.0:1788863854.164039:0:18563:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788863854.172712:0:18563:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863854.172899:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788863854.172905:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788863854.175770:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788863854.175782:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788863854.177336:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788863854.177346:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788863854.199782:0:18563:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863854.200626:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788863854.200635:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788863854.201825:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788863854.201835:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788863854.228627:0:18563:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863854.229036:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788863854.229044:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788863854.231930:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788863854.231941:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788863854.244005:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788863854.244026:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788863854.247152:0:18563:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863854.248385:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788863854.248392:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788863854.266118:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788863854.266138:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788863854.318202:0:18563:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863854.318399:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788863854.318406:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788863854.320475:0:18563:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788863854.320490:0:18563:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788863854.324303:0:18563:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788863854.324345:0:18563:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788863854.324353:0:18563:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788863854.335823:0:18563:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788863854.335863:0:18563:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788863854.335868:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788863854.335870:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863854.335871:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863854.335873:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863854.335874:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863854.335876:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863854.335877:0:18563:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863854.335879:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863854.335881:0:18563:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863854.335885:0:18563:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788863854.335887:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863854.335889:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863854.335890:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863854.335891:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863854.335892:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863854.335899:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863854.335900:0:18563:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863854.335901:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863854.335902:0:18563:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863854.335930:0:18563:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788863854.335950:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788863854.336022:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.336208:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9cac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863854.336264:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609408 00000100:00100000:2.0:1788863854.336272:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609408 00000100:00100000:2.0:1788863854.336331:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788863854.336341:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:18563:x1875759226609408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788863854.336370:0:17054:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788863854.336375:0:17054:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788863854.336379:0:17054:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788863854.336694:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:18563:x1875759226609408:12345-0@lo:253:mount.lustre.0 Request processed in 353us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863854.336703:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863854.336779:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609408:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788863854.336789:0:18563:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788863854.336791:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788863854.336793:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863854.336793:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863854.336794:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863854.336795:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863854.336797:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863854.336798:0:18563:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863854.336800:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863854.336801:0:18563:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788863854.336817:0:18563:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e67b71c000 from lustre-OST0000 10000000:01000000:0.0:1788863854.336839:0:18563:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788863854.336842:0:18563:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788863854.336849:0:18563:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e5428e99c0 local copy 00010000:00010000:0.0:1788863854.336858:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.336948:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863854.336977:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.337000:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788863854.337071:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609536 00000100:00100000:3.0:1788863854.337184:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609536 00000100:00100000:3.0:1788863854.337264:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788863854.337273:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:18563:x1875759226609536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863854.337348:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:18563:x1875759226609536:12345-0@lo:501:mount.lustre.0 Request processed in 77us (370us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863854.337356:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788863854.337415:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609536:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788863854.337428:0:18563:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788863854.337445:0:18563:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788863854.337457:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.337467:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863854.337507:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e67b71c000 10000000:01000000:0.0:1788863854.337513:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788863854.337518:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788863854.337521:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863854.337525:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788863854.337528:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788863854.337551:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.337560:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.337570:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.337585:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788863854.337626:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.337819:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1788863854.337909:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609664 00000100:00100000:1.0:1788863854.337915:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609664 00000100:00100000:1.0:1788863854.337940:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788863854.337948:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+18:18563:x1875759226609664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863854.337958:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863854.337971:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b6a071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a06a expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.337994:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b6a071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a06a expref: 19 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.338019:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b6a071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a06a expref: 19 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.338028:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ec00, rc 0) 00000100:00100000:1.0:1788863854.338072:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226609664:12345-0@lo:101:mount.lustre.0 Request processed in 124us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.338107:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863854.338187:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863854.338201:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.338211:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863854.339230:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788863854.339812:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863854.342141:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788863854.342193:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788863854.342205:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788863854.342217:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788863854.342228:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788863854.342240:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788863854.342267:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788863854.342273:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788863854.342379:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863854.342442:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.342489:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863854.342585:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609792 00000100:00100000:1.0:1788863854.342594:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609792 00000100:00100000:1.0:1788863854.342666:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788863854.342676:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226609792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863854.342831:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226609792:12345-0@lo:501:mount.lustre.0 Request processed in 157us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.342840:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863854.342893:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863854.342926:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863854.342962:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.343053:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788863854.343239:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226609920 00000100:00100000:3.0:1788863854.343245:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226609920 00000100:00100000:3.0:1788863854.343318:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788863854.343328:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226609920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863854.344041:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226609920:12345-0@lo:503:mount.lustre.0 Request processed in 713us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863854.344049:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863854.344173:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226609920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788863854.344795:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863854.344884:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863854.344949:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.344996:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788863854.345102:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610048 00000100:00100000:2.0:1788863854.345109:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610048 00000100:00100000:2.0:1788863854.345159:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788863854.345169:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226610048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863854.345795:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226610048:12345-0@lo:502:mount.lustre.0 Request processed in 624us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863854.345803:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788863854.345941:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788863854.346297:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788863854.346343:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788863854.346370:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788863854.346387:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788863854.346402:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788863854.346416:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788863854.346431:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788863854.346446:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788863854.346461:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788863854.346476:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788863854.346489:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788863854.346584:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788863854.346634:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863854.346683:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.346732:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788863854.346773:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610176 00000100:00100000:3.0:1788863854.346780:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610176 00000100:00100000:3.0:1788863854.346822:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788863854.346829:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226610176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863854.346990:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226610176:12345-0@lo:502:mount.lustre.0 Request processed in 161us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863854.347006:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788863854.347072:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863854.347135:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788863854.347144:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788863854.347848:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788863854.347856:0:18580:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788863854.347868:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863854.347871:0:18580:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788863854.347877:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863854.347892:0:18580:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89e67b6c3380) 00000020:00000080:2.0:1788863854.347916:0:18580:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788863854.347923:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788863854.348002:0:18580:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67b71c000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788863854.348011:0:18580:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788863854.348018:0:18580:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf569beb9d4b6a07f 00010000:00010000:2.0:1788863854.356072:0:18580:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788863854.356644:0:18580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788863854.358241:0:18580:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788863854.361308:0:18580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788863854.361327:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863854.361333:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863854.361335:0:18580:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788863854.361340:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788863854.361343:0:18580:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788863854.361345:0:18580:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863854.361346:0:18580:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863854.361348:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788863854.361351:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863854.361352:0:18580:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788863854.361355:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863854.361357:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863854.361359:0:18580:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788863854.361361:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863854.361363:0:18580:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788863854.361366:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863854.361368:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863854.361370:0:18580:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788863854.361372:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863854.361387:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863854.361388:0:18580:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788863854.361392:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788863854.361421:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863854.361424:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863854.361426:0:18580:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788863854.361429:0:18580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788863854.361722:0:18563:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788863854.361752:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788863854.361776:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.361788:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863854.361797:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67b71c000 from 1 10000000:01000000:1.0:1788863854.361807:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863854.361849:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.361857:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.361881:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863854.361906:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863854.361995:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.362049:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64a8ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863854.362266:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610304 00000100:00100000:2.0:1788863854.362275:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610304 00000100:00100000:2.0:1788863854.362323:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863854.362332:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226610304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863854.362345:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863854.362360:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a086 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.362386:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 20 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.362396:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 20 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.362405:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922200, rc 0) 00000100:00100000:2.0:1788863854.362452:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610304:12345-0@lo:101:mount.lustre.0 Request processed in 120us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863854.362459:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788863854.363165:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863854.363186:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.363197:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863854.369184:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788863854.369537:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863854.371437:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788863854.371503:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788863854.371533:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788863854.371541:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788863854.372122:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863854.372191:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.372286:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788863854.373649:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610432 00000100:00100000:3.0:1788863854.373663:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610432 00000100:00100000:3.0:1788863854.373905:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788863854.373916:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863854.374325:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610432:12345-0@lo:501:mount.lustre.0 Request processed in 410us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863854.374334:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788863854.375659:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863854.375739:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863854.375806:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.375908:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610560 00000100:00100000:0.0:1788863854.375915:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610560 00000100:00100000:0.0:1788863854.375964:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788863854.375973:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863854.375988:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e543bd5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788863854.378387:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610560:12345-0@lo:503:mount.lustre.0 Request processed in 2406us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.378403:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788863854.378618:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863854.379763:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863854.380221:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863854.380318:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.380377:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649af59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863854.380458:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610688 00000100:00100000:3.0:1788863854.380466:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610688 00000100:00100000:3.0:1788863854.380554:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788863854.380564:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863854.380716:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610688:12345-0@lo:502:mount.lustre.0 Request processed in 154us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863854.380725:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788863854.381019:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863854.381296:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788863854.381325:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788863854.381341:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788863854.381355:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788863854.381369:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788863854.381382:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788863854.381395:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788863854.381407:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788863854.381420:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788863854.381433:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788863854.381445:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788863854.381473:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863854.381516:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.382446:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610816 00000100:00100000:0.0:1788863854.382457:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610816 00000100:00100000:1.0:1788863854.382481:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649af59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863854.382497:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788863854.382505:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863854.382643:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610816:12345-0@lo:502:mount.lustre.0 Request processed in 138us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.382650:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788863854.382696:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863854.382763:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788863854.382775:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788863854.383824:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863854.383843:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.383845:0:18584:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788863854.383852:0:18584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e67b71c000 00000020:00000080:3.0:1788863854.383855:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863854.383984:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863854.383989:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.383990:0:18584:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788863854.383993:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863854.383996:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.383997:0:18584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788863854.384001:0:18584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e67b71c000 00000020:00000080:3.0:1788863854.384003:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863854.384263:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863854.384268:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.384270:0:18584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788863854.384272:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863854.384275:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.384276:0:18584:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863854.384280:0:18584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e67b71c000 00000020:00000080:3.0:1788863854.384282:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863854.385776:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863854.385787:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.385789:0:18584:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863854.385793:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863854.385797:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.385799:0:18584:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788863854.385809:0:18584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e67b71c000 00000020:00000080:3.0:1788863854.385813:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863854.385872:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863854.385876:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863854.385878:0:18584:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788863854.385881:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788863854.386131:0:18563:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788863854.386164:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788863854.386182:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.386194:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863854.386247:0:18563:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788863854.386250:0:18563:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e67b71c000 10000000:01000000:1.0:1788863854.386253:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e67b71c000 10000000:01000000:1.0:1788863854.386257:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863854.386263:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e67b71c000 from 1 10000000:01000000:1.0:1788863854.386265:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863854.386299:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.386307:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.386318:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863854.386340:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863854.386399:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.386479:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649af5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863854.386525:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226610944 00000100:00100000:3.0:1788863854.386531:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226610944 00000100:00100000:3.0:1788863854.386610:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863854.386619:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:18563:x1875759226610944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863854.386631:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863854.386643:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b6a09b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a094 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863854.386665:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b6a09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a094 expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863854.386674:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b6a09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a094 expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863854.386690:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98a00, rc 0) 00000100:00100000:3.0:1788863854.386730:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226610944:12345-0@lo:101:mount.lustre.0 Request processed in 113us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863854.386737:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863854.386814:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226610944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863854.386828:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863854.386837:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863854.387906:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788863854.388220:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788863854.388456:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788863854.388558:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788863854.388586:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788863854.388618:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788863854.388637:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788863854.388658:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788863854.388676:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788863854.388697:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788863854.388718:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788863854.388735:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788863854.388755:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788863854.388777:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788863854.388793:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788863854.388805:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788863854.388819:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788863854.388845:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788863854.388863:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788863854.388888:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788863854.388898:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788863854.388908:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788863854.388917:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788863854.388927:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788863854.388936:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788863854.388946:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788863854.388956:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788863854.388965:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788863854.388974:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788863854.388985:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788863854.388998:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788863854.389010:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788863854.389025:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788863854.389037:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788863854.389052:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788863854.389151:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788863854.389169:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788863854.389178:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788863854.389188:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788863854.389205:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788863854.389210:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788863854.389293:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863854.389347:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863854.389432:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788863854.389561:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611072 00000100:00100000:1.0:1788863854.389569:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611072 00000100:00100000:1.0:1788863854.390706:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788863854.390785:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863854.397364:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611072:12345-0@lo:501:mount.lustre.0 Request processed in 6638us (8006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.397380:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788863854.397457:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863854.397516:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863854.397583:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863854.397642:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611200 00000100:00100000:2.0:1788863854.397644:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863854.397651:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611200 00000100:00100000:3.0:1788863854.397708:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788863854.397717:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863854.397850:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611200:12345-0@lo:503:mount.lustre.0 Request processed in 134us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863854.397857:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788863854.399208:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788863854.399702:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863854.399783:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863854.399841:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863854.399873:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788863854.400006:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611328 00000100:00100000:1.0:1788863854.400013:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611328 00000100:00100000:1.0:1788863854.400059:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788863854.400067:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863854.400195:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611328:12345-0@lo:502:mount.lustre.0 Request processed in 128us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.400202:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788863854.400298:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788863854.400457:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788863854.400563:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788863854.400581:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788863854.400593:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788863854.400621:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788863854.400634:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788863854.400646:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788863854.400657:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788863854.400668:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788863854.400680:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788863854.400692:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788863854.400704:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788863854.400717:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788863854.400730:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788863854.400745:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788863854.400756:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788863854.400769:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788863854.400796:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788863854.400818:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788863854.400831:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788863854.400844:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788863854.400857:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788863854.400869:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788863854.400881:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788863854.400892:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788863854.400902:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788863854.400913:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788863854.400924:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788863854.400937:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788863854.400950:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788863854.400962:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788863854.400975:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788863854.400988:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788863854.401013:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788863854.401026:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788863854.401037:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788863854.401047:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788863854.401058:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788863854.401068:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788863854.403725:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788863854.403765:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788863854.403780:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788863854.403794:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788863854.403807:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788863854.403819:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788863854.403833:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788863854.403847:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788863854.403861:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788863854.403936:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863854.404018:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863854.404107:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863854.406660:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611456 00000100:00100000:0.0:1788863854.406677:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611456 00000100:00100000:0.0:1788863854.406783:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788863854.406794:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863854.406975:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611456:12345-0@lo:502:mount.lustre.0 Request processed in 182us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.406985:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863854.407111:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788863854.407335:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788863854.407364:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788863854.407399:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863854.407446:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.410920:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611584 00000100:00100000:1.0:1788863854.410933:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611584 00000100:00100000:2.0:1788863854.410951:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788863854.411429:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788863854.411440:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863854.411766:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611584:12345-0@lo:502:mount.lustre.0 Request processed in 327us (4318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.411775:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788863854.411982:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788863854.412063:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788863854.412144:0:18563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788863854.412963:0:18589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788863854.412982:0:18589:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89e67b6c0000) 00000020:00000080:2.0:1788863854.413004:0:18589:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788863854.413143:0:18589:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67b71c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788863854.413148:0:18589:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67b71c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788863854.413151:0:18589:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67b71c000 3 00010000:00080000:2.0:1788863854.413183:0:18589:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e5425bf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863854.417136:0:18589:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788863854.417343:0:18589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788863854.417389:0:18589:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863854.417403:0:18589:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf569beb9d4b6a0a9 00000100:00080000:2.0:1788863854.417414:0:18589:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863854.417427:0:18589:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425bf000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863854.417465:0:18589:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543b79c00 x1875759226611712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863854.419799:0:18589:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788863854.419899:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226611712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788863854.419973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863854.420152:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611712 00000100:00100000:3.0:1788863854.420161:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611712 00000100:00100000:3.0:1788863854.420204:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863854.420213:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226611712:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788863854.420242:0:17060:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1788863854.420278:0:17060:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf569beb9d4b6a0b0 00000004:00100000:3.0:1788863854.420294:0:17060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788863854.420332:0:17060:0:(import.c:65:import_set_state_nolock()) ffff89e5427b8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863854.420386:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875759226611712:12345-0@lo:38:llog_process_th.0 Request processed in 174us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863854.420394:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788863854.420435:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e543b79c00 x1875759226611712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863854.420446:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863854.420454:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788863854.420461:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788863854.420465:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788863854.420468:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788863854.420474:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226611712:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788863854.422473:0:18589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788863854.422504:0:18589:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff89e6763c19c0) 00000020:00000080:1.0:1788863854.422529:0:18589:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788863854.422622:0:18589:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e67b71c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788863854.422626:0:18589:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67b71c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788863854.422629:0:18589:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67b71c000 3 00010000:00080000:1.0:1788863854.422659:0:18589:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e676190800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788863854.424273:0:18589:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788863854.424480:0:18589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788863854.424523:0:18589:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788863854.424536:0:18589:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf569beb9d4b6a0be 00000100:00080000:1.0:1788863854.424546:0:18589:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863854.424557:0:18589:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89e676190800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863854.424593:0:18589:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af5bb80 x1875759226611840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863854.424636:0:18589:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788863854.425008:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226611840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788863854.425249:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863854.425619:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611840 00000100:00100000:2.0:1788863854.425633:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611840 00000100:00100000:2.0:1788863854.425677:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863854.425685:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226611840:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788863854.425714:0:17062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:2.0:1788863854.425748:0:17062:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf569beb9d4b6a0c5 00000004:00100000:2.0:1788863854.425763:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788863854.425793:0:17062:0:(import.c:65:import_set_state_nolock()) ffff89e5425bb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863854.425848:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875759226611840:12345-0@lo:38:llog_process_th.0 Request processed in 162us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863854.425856:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788863854.425937:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e67af5bb80 x1875759226611840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863854.425948:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863854.425956:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788863854.425964:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788863854.425968:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788863854.425971:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676190800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788863854.425976:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226611840:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788863854.430638:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788863854.430697:0:18563:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788863854.430734:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788863854.430751:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.430764:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788863854.430814:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788863854.430817:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863854.430818:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863854.430819:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863854.430820:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863854.430822:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863854.430823:0:18563:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863854.430825:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863854.430827:0:18563:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863854.430831:0:18563:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788863854.430833:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863854.430834:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863854.430835:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863854.430836:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863854.430842:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863854.430843:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863854.430844:0:18563:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863854.430845:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863854.430846:0:18563:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863854.430871:0:18563:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788863854.430890:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788863854.430962:0:18563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.431014:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64a8ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863854.432728:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226611968 00000100:00100000:0.0:1788863854.432741:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226611968 00000100:00100000:0.0:1788863854.432805:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788863854.432815:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:18563:x1875759226611968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863854.432848:0:17053:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788863854.432862:0:17053:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788863854.433008:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863854.433012:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863854.433015:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863854.433018:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863854.433036:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226612096:0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.433116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.433179:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612096 00000100:00100000:0.0:1788863854.433184:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612096 00000100:00100000:0.0:1788863854.433211:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863854.433218:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226612096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.433266:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226612096:12345-0@lo:400:kworker.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.433273:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863854.433315:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226612096:0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.433351:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226612224:0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.433379:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.433416:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612224 00000100:00100000:0.0:1788863854.433420:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612224 00000100:00100000:0.0:1788863854.433447:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863854.433453:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226612224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.434724:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226612224:12345-0@lo:400:kworker.0 Request processed in 1263us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.434734:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788863854.434793:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dd180 x1875759226612224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863854.434806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226612224:0@lo:400:kworker.0 00000100:00080000:0.0:1788863854.434849:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863854.434854:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863854.434857:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863854.434860:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863854.434875:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226612352:0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.434913:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.434955:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612352 00000100:00100000:0.0:1788863854.434961:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612352 00000100:00100000:0.0:1788863854.434990:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863854.434997:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226612352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.435053:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226612352:12345-0@lo:400:kworker.0 Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.435060:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863854.435107:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226612352:0@lo:400:kworker.0 00000100:00100000:0.0:1788863854.435140:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226612480:0@lo:400:kworker.0 00000100:00080000:1.0:1788863854.437147:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863854.437157:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863854.437159:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863854.437239:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863854.437243:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863854.437246:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863854.437248:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863854.437251:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863854.437334:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:0.0:1788863854.437875:0:17053:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788863854.437893:0:17053:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788863854.437969:0:17076:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788863854.437974:0:17076:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788863854.437994:0:17076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438011:0:17076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438019:0:17076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438026:0:17076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438060:0:17076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438092:0:17076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 21 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.438107:0:17076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226612608:0@lo:104: 00000100:00100000:0.0:1788863854.438150:0:17076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863854.438271:0:17076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438279:0:17076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 21 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.438288:0:17076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226612736:0@lo:104: 00000100:00100000:0.0:1788863854.438315:0:17076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.438338:0:17076:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642a926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863854.438361:0:17044:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788863854.438377:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612608 00000100:00100000:0.0:1788863854.438383:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612608 00000100:00100000:0.0:1788863854.438414:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612736 00000100:00100000:0.0:1788863854.438417:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612736 00000100:00100000:0.0:1788863854.438430:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863854.438437:0:17044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:17076:x1875759226612608:12345-0@lo:104: 00010000:00010000:0.0:1788863854.438450:0:17044:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438494:0:17044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863854.438499:0:17044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:17076:x1875759226612608:12345-0@lo:104: Request processed in 63us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.438506:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863854.438522:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863854.438528:0:17044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226612736:12345-0@lo:104: 00010000:00010000:0.0:1788863854.438535:0:17044:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438564:0:17044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788863854.438569:0:17044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226612736:12345-0@lo:104: Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.438574:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863854.438639:0:17076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226612608:0@lo:104: 00000100:00100000:0.0:1788863854.438646:0:17076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226612736:0@lo:104: 00010000:00010000:0.0:1788863854.438664:0:17076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438690:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863854.438696:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438703:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863854.438707:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438715:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863854.438722:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863854.438728:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863854.438756:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438762:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863854.438779:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438785:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650923800/0xf569beb9d4b6a01d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a024 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438796:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863854.438799:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438814:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863854.438817:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438823:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863854.438829:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863854.438834:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863854.438846:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438851:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863854.438857:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438863:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a00f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a016 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.438876:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863854.438878:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863854.438879:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863854.438887:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863854.438905:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226612864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863854.438931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.438954:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863854.438960:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226612992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863854.438991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.439021:0:17047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612864 00000100:00100000:0.0:1788863854.439026:0:17047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612864 00010000:00010000:0.0:1788863854.439042:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 22 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.439061:0:17047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612992 00000100:00100000:0.0:1788863854.439064:0:17047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612992 00010000:00010000:0.0:1788863854.439073:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 23 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.439114:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863854.439121:0:17047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:3642:x1875759226612864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863854.439131:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863854.439137:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 23 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.439146:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 23 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.439158:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a01d expref: 23 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863854.440342:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863854.440357:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6586c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:3642:x1875759226612992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863854.440375:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863854.440382:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 22 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440395:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 22 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440409:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a00f expref: 22 pid: 17055 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440421:0:17046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440430:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863854.440443:0:17046:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004627317s 00010000:00010000:2.0:1788863854.440454:0:17046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440462:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440468:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440475:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440480:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863854.440497:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440506:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440524:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.440536:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863854.440592:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6586c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3642:x1875759226612992:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863854.440613:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788863854.443666:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863854.443748:0:17047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:3642:x1875759226612864:12345-0@lo:103:ldlm_bl.0 Request processed in 4622us (4810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.443760:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788863854.443840:0:17076:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.443864:0:17076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.443871:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259b600/0xf569beb9d4b6a0cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.443914:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226612992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863854.443924:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226612864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863854.444038:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:18563:x1875759226611968:12345-0@lo:253:mount.lustre.0 Request processed in 11224us (13075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.444046:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788863854.444103:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:18563:1875759226611968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788863854.444118:0:18563:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788863854.444120:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788863854.444123:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863854.444124:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863854.444125:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863854.444126:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863854.444128:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863854.444129:0:18563:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863854.444131:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863854.444132:0:18563:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788863854.444142:0:18563:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788863854.447648:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226612480 00000100:00100000:1.0:1788863854.447663:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226612480 00000100:00100000:1.0:1788863854.447728:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863854.447739:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226612480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863854.447833:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226612480:12345-0@lo:400:kworker.0 Request processed in 96us (10499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.447841:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788863854.448627:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dd180 x1875759226612480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863854.448667:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226612480:0@lo:400:kworker.0 00000001:00000004:1.0:1788863854.454937:0:18563:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788863854.460022:0:18563:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788863854.460032:0:18563:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788863854.460070:0:18563:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788863854.460279:0:18563:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788863854.460304:0:18563:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788863854.460329:0:18563:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788863854.461247:0:18563:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788863854.461468:0:18563:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863854.829662:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863855.148803:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788863855.272050:0:18642:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788863855.272476:0:18642:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788863855.851536:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788863855.982930:0:17058:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863855.982938:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5425c9800 from 9 10000000:01000000:2.0:1788863855.982942:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863855.983003:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863855.983023:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863855.983034:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863855.983061:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863855.983153:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863855.983209:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863855.983213:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226613120 00000100:00100000:1.0:1788863855.983220:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226613120 00000100:00100000:1.0:1788863855.983286:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788863855.983295:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:17058:x1875759226613120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863855.983308:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863855.983322:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a0d3 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.983346:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 20 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.983356:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 20 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.983364:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fc00, rc 0) 00000100:00100000:1.0:1788863855.983519:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:17058:x1875759226613120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863855.983527:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788863855.983617:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863855.983632:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863855.983641:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863855.983694:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788863855.983724:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863855.983752:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863855.983804:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226613248 00000100:00100000:3.0:1788863855.983810:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226613248 00000100:00100000:3.0:1788863855.983844:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788863855.983851:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:17058:x1875759226613248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788863855.983865:0:17053:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788863855.983885:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788863855.983889:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788863855.984100:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:17058:x1875759226613248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863855.984108:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788863855.984945:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788863855.985013:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788863855.985021:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.985031:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863855.985040:0:17058:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788863855.985042:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5448c2800 from 9 10000000:01000000:1.0:1788863855.985045:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788863855.985071:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.985243:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.985253:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863855.985353:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863855.985462:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863855.985500:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c148000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863855.985548:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226613376 00000100:00100000:1.0:1788863855.985635:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226613376 00000100:00100000:1.0:1788863855.985709:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788863855.985717:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:17058:x1875759226613376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863855.985727:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863855.985739:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a0e1 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.985758:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 21 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.985777:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 21 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.985786:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f600, rc 0) 00000100:00100000:1.0:1788863855.985836:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226613376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863855.985843:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788863855.985966:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863855.985979:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863855.985988:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863855.986036:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788863855.986067:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863855.986233:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c148000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863855.986355:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226613504 00000100:00100000:1.0:1788863855.986360:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226613504 00000100:00100000:1.0:1788863855.986385:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788863855.986448:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226613504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788863855.986463:0:17054:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788863855.986477:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788863855.986480:0:17054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788863855.986550:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226613504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863855.986579:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788863855.986624:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226613504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788863855.986666:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788863855.986672:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863855.986680:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863856.876277:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863857.919300:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863858.668826:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226613632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863858.668906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863858.668968:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226613632 00000100:00100000:1.0:1788863858.668977:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226613632 00000100:00100000:1.0:1788863858.669022:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863858.669031:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226613632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863858.669065:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788863858.669124:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226613632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863858.669131:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863858.669175:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226613632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863858.671274:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226613760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863858.671334:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863858.671413:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226613760 00000100:00100000:1.0:1788863858.671421:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226613760 00000100:00100000:1.0:1788863858.671461:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863858.671470:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226613760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863858.671500:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788863858.671563:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226613760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863858.671571:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863858.671612:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226613760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788863858.927350:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863859.435834:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788863859.700243:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863859.700250:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863859.700253:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863859.700256:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863859.700292:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863859.701855:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863859.701858:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863859.701860:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863859.701929:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226613888:0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.702001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863859.702117:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226614144:0@lo:400:kworker.0 00000100:00100000:3.0:1788863859.702153:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863859.702184:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226614656:0@lo:400:kworker.0 00000100:00100000:3.0:1788863859.702202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863859.702223:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863859.702229:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226614272:0@lo:400:kworker.0 00000100:00100000:3.0:1788863859.702272:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863859.702311:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226614016:0@lo:400:kworker.0 00000100:00100000:3.0:1788863859.702332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863859.702361:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226614528:0@lo:400:kworker.0 00000100:00100000:3.0:1788863859.702393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863859.702625:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226614400:0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.702785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863859.702825:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614144 00000100:00100000:0.0:1788863859.702832:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614144 00000100:00100000:0.0:1788863859.702870:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614656 00000100:00100000:0.0:1788863859.702874:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614656 00000100:00100000:0.0:1788863859.702909:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614528 00000100:00100000:0.0:1788863859.702912:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614528 00000100:00100000:0.0:1788863859.702924:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614400 00000100:00100000:0.0:1788863859.702926:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614400 00000100:00100000:0.0:1788863859.702941:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863859.702949:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226614144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.703003:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226614144:12345-0@lo:400:kworker.0 Request processed in 55us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863859.703010:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863859.703026:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863859.703032:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226614656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.703059:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226614656:12345-0@lo:400:kworker.0 Request processed in 28us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863859.703064:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863859.703098:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863859.703104:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226614528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.703137:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226614528:12345-0@lo:400:kworker.0 Request processed in 34us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863859.703141:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863859.703153:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863859.703159:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226614400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.703187:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226614400:12345-0@lo:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863859.703199:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788863859.703236:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5438ddc00 x1875759226614144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863859.703251:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226614144:0@lo:400:kworker.0 00010000:00080000:0.0:1788863859.703268:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544004a80 x1875759226614656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863859.703276:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226614656:0@lo:400:kworker.0 00010000:00080000:0.0:1788863859.703308:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544005880 x1875759226614528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863859.703317:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226614528:0@lo:400:kworker.0 00010000:00080000:0.0:1788863859.703336:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5438dd180 x1875759226614400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863859.703345:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226614400:0@lo:400:kworker.0 00000100:00100000:1.0:1788863859.703989:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614272 00000100:00100000:1.0:1788863859.703994:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614272 00000100:00100000:1.0:1788863859.704025:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614016 00000100:00100000:1.0:1788863859.704028:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614016 00000100:00100000:1.0:1788863859.704042:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863859.704057:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226614272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863859.704138:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226614272:12345-0@lo:400:kworker.0 Request processed in 82us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863859.704145:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863859.704162:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863859.704168:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226614016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863859.704200:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226614016:12345-0@lo:400:kworker.0 Request processed in 33us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863859.704206:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863859.704237:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226614016:0@lo:400:kworker.0 00000100:00080000:3.0:1788863859.705589:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863859.705597:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863859.706875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226614272:0@lo:400:kworker.0 00000100:00100000:2.0:1788863859.710743:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226613888 00000100:00100000:2.0:1788863859.710758:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226613888 00000100:00100000:2.0:1788863859.711414:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788863859.711425:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3642:x1875759226613888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863859.711533:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3642:x1875759226613888:12345-0@lo:400:kworker.0 Request processed in 110us (9530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863859.711540:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863859.715169:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226613888:0@lo:400:kworker.0 00010000:00010000:2.0:1788863859.949409:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788863860.917763:0:18932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788863860.972255:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863861.952938:0:18984:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863861.953183:0:18984:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788863861.995343:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863862.636898:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863847/real 1788863847] req@ffff89e5440c1f80 x1875759226606592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863862 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863862.636931:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5440c1f80 x1875759226606592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863862 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863862.636942:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863847/real 1788863847] req@ffff89e5440c2680 x1875759226606720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863862 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863862.636973:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5440c2680 x1875759226606720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863862 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788863862.636995:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544175800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863862.637017:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788863862.637021:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226606592:0@lo:8:kworker.0 00000100:00080000:0.0:1788863862.637028:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863862.637033:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788863862.637036:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226606720:0@lo:8:kworker.0 00000100:00080000:3.0:1788863862.637283:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863862.637288:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788863862.637292:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863862.637295:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788863862.637343:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863862.637346:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788863862.637349:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e544175800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863862.637354:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1788863862.637361:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788863862.637372:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89e544175800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863862.637394:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543bf2300 x1875759226615296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863862.637409:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863862.637412:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788863862.637420:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863862.637423:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1788863862.637426:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788863862.637432:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e67b6ae000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863862.637459:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543bf2680 x1875759226615424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788863862.637502:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226614912:0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.637565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863862.637630:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226615680:0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.637660:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863862.637681:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788863862.637687:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226615040:0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.637709:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863862.637723:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226615808:0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.637740:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863862.637772:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614912 00000100:00100000:3.0:1788863862.637781:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614912 00000100:00100000:3.0:1788863862.637830:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863862.637839:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226614912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.637915:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226614912:12345-0@lo:400:kworker.0 Request processed in 76us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863862.637923:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863862.637945:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615680 00000100:00100000:3.0:1788863862.637949:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615680 00000100:00100000:3.0:1788863862.637977:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615040 00000100:00100000:3.0:1788863862.637980:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615040 00000100:00100000:3.0:1788863862.638000:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615808 00000100:00100000:3.0:1788863862.638003:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615808 00000100:00100000:3.0:1788863862.638023:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863862.638030:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226615680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.638064:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226615680:12345-0@lo:400:kworker.0 Request processed in 35us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863862.638070:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863862.638119:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788863862.638124:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226615040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.638153:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226615040:12345-0@lo:400:kworker.0 Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863862.638157:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788863862.638169:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788863862.638174:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226615808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863862.638198:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226615808:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863862.638203:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788863862.638223:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863862.638227:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863862.638238:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226615296:0@lo:8:kworker.0 00000100:00100000:3.0:1788863862.638263:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863862.638288:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226615424:0@lo:8:kworker.0 00000100:00100000:3.0:1788863862.638309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863862.638343:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615296 00000100:00100000:3.0:1788863862.638347:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615296 00000100:00100000:3.0:1788863862.638363:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615424 00000100:00100000:3.0:1788863862.638365:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615424 00000100:00100000:3.0:1788863862.638384:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863862.638388:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226615296:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788863862.638413:0:18568:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1788863862.638457:0:18568:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6a0ef 00002000:00100000:3.0:1788863862.638471:0:18568:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89e5427bb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788863862.638476:0:18568:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788863862.638478:0:18568:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788863862.638667:0:18568:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788863862.638695:0:18568:0:(import.c:65:import_set_state_nolock()) ffff89e5427bc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863862.638738:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226615296:12345-0@lo:8:kworker.0 Request processed in 348us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863862.638744:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863862.638758:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863862.638763:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226615424:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788863862.638775:0:18568:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788863862.640280:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226614784:0@lo:400:kworker.0 00000100:00100000:0.0:1788863862.640344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863862.640372:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226615552:0@lo:400:kworker.0 00000100:00100000:0.0:1788863862.640394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863862.640419:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863862.640424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226615168:0@lo:400:kworker.0 00000100:00100000:0.0:1788863862.640460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863862.640495:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615552 00000100:00100000:0.0:1788863862.640501:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615552 00000100:00100000:0.0:1788863862.640538:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863862.640546:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226615552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863862.640592:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226615552:12345-0@lo:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863862.640599:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863862.640643:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226614784 00000100:00100000:0.0:1788863862.640662:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226614784 00000100:00100000:0.0:1788863862.640690:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788863862.640695:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3641:x1875759226614784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863862.640721:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3641:x1875759226614784:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863862.640727:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788863862.640751:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615168 00000100:00100000:0.0:1788863862.640754:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615168 00000100:00100000:0.0:1788863862.640776:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863862.640781:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226615168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863862.640809:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226615168:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863862.640815:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863862.640867:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226615168:0@lo:400:kworker.0 00000100:00100000:0.0:1788863862.640879:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226614784:0@lo:400:kworker.0 00010000:00080000:0.0:1788863862.640890:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543bf1500 x1875759226615552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863862.640900:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226615552:0@lo:400:kworker.0 00010000:00080000:1.0:1788863862.646496:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543bf3800 x1875759226615040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863862.646521:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226615040:0@lo:400:kworker.0 00010000:00080000:1.0:1788863862.646549:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543bf0a80 x1875759226615808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863862.646558:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226615808:0@lo:400:kworker.0 00000100:00100000:1.0:1788863862.646572:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226614912:0@lo:400:kworker.0 00010000:00080000:1.0:1788863862.646583:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543bf1880 x1875759226615680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863862.646591:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226615680:0@lo:400:kworker.0 00010000:00080000:0.0:1788863862.653847:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543bf2300 x1875759226615296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863862.653864:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863862.653875:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788863862.653886:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788863862.653891:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788863862.653894:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544175800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788863862.653940:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788863862.653948:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226615296:0@lo:8:kworker.0 00000004:00080000:1.0:1788863862.654110:0:17802:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788863862.654136:0:17802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17802:1875759226616064:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788863862.654209:0:17802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863862.654240:0:17802:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863862.654265:0:18569:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788863862.654272:0:18569:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788863862.654370:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863862.654383:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226615936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863862.654409:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863862.654478:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616064 00000100:00100000:1.0:1788863862.654485:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616064 00000100:00100000:1.0:1788863862.654608:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863862.654618:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17802:x1875759226616064:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788863862.660242:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226615936 00000100:00100000:2.0:1788863862.660260:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226615936 00000100:00100000:2.0:1788863862.660317:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863862.660328:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875759226615936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863862.660420:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788863862.664013:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875759226615936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3677us (9592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863862.664030:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788863862.664047:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af59f80 x1875759226615936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863862.664103:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226615936:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788863862.673053:0:17801:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788863862.676280:0:17801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 529800200538ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788863862.676289:0:17801:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1788863862.676324:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863862.676426:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226615424:12345-0@lo:8:kworker.0 Request processed in 37657us (38111us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788863862.676452:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788863862.676505:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863862.676511:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788863862.676517:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226615424:0@lo:8:kworker.0 00000004:00080000:2.0:1788863862.679908:0:17793:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788863862.680682:0:19012:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788863862.680691:0:19012:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788863862.680810:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17802:x1875759226616064:12345-0@lo:7:osp-pre-0-1.0 Request processed in 26189us (26598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863862.680821:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788863862.680881:0:17802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af58380 x1875759226616064/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863878 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863862.680896:0:17802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17802:1875759226616064:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788863862.680911:0:17802:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788863862.680954:0:17802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17802:1875759226616192:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788863862.680989:0:17802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863862.681021:0:17802:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863862.681230:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616192 00000100:00100000:1.0:1788863862.681237:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616192 00000100:00100000:1.0:1788863862.681369:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863862.681380:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17802:x1875759226616192:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788863862.681406:0:18569:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788863862.681463:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17802:x1875759226616192:12345-0@lo:5:osp-pre-0-1.0 Request processed in 84us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863862.681470:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788863862.681478:0:17802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543b7b800 x1875759226616192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863878 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863862.681492:0:17802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17802:1875759226616192:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788863862.681503:0:17802:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788863862.681544:0:17802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17802:1875759226616320:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788863862.681568:0:17802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863862.681593:0:17802:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863862.681610:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616320 00000100:00100000:3.0:1788863862.681623:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616320 00000100:00100000:3.0:1788863862.681657:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863862.681664:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17802:x1875759226616320:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788863862.681690:0:18568:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1788863862.707771:0:18564:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788863862.707788:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788863862.709226:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17802:x1875759226616320:12345-0@lo:5:osp-pre-0-1.0 Request processed in 27556us (27650us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788863862.709239:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788863862.711008:0:17802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543b7b800 x1875759226616320/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863878 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863862.711024:0:17802:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788863862.711031:0:17802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17802:1875759226616320:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788863862.711049:0:17802:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788863862.711127:0:17802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17802:1875759226616448:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788863862.711187:0:17802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863862.711234:0:17802:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d973c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863862.711261:0:17071:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616448 00000100:00100000:3.0:1788863862.711269:0:17071:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616448 00000100:00100000:3.0:1788863862.711321:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863862.711330:0:17071:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17802:x1875759226616448:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788863862.711392:0:17071:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17802:x1875759226616448:12345-0@lo:900:osp-pre-0-1.0 Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863862.711399:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788863862.711426:0:17802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af59f80 x1875759226616448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788863878 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863862.711448:0:17802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17802:1875759226616448:0@lo:900:osp-pre-0-1.0 00000020:00000004:2.0:1788863862.992551:0:19035:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788863862.992971:0:19035:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788863863.021949:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863863.788771:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226616576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863863.788869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863863.788921:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863863.788953:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226616704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863863.788959:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616576 00000100:00100000:2.0:1788863863.788969:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616576 00000100:00100000:0.0:1788863863.789024:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863863.789035:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863863.789051:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226616576:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863863.789112:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616704 00000004:00000024:2.0:1788863863.789123:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863863.789124:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616704 00000100:00100000:0.0:1788863863.789173:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788863863.789184:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226616704:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863863.789197:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226616576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863863.789206:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00000024:0.0:1788863863.789223:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788863863.789273:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226616576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863863.789291:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226616704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863863.789300:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788863863.789363:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226616704:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788863864.057829:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863865.071060:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863865.387800:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788863866.091928:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863867.115332:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863867.884666:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226616832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863867.884738:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863867.884827:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616832 00000100:00100000:3.0:1788863867.884834:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616832 00000100:00100000:3.0:1788863867.884882:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863867.884890:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226616832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863867.884918:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788863867.884958:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226616832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863867.884983:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788863867.885004:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863867.885033:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543bf2680 x1875759226616832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863867.885050:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226616832:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788863867.885550:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863867.885555:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863867.885558:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863867.885561:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863867.885579:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863867.885582:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788863867.885586:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863867.885592:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1788863867.885596:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788863867.885605:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e67b6ae000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863867.885622:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af58380 x1875759226617472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863867.885665:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226617088:0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.885712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863867.885746:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226617728:0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.885772:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863867.885793:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788863867.885798:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226616960:0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.885822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863867.885845:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226617600:0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.885864:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863867.885890:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226617472:0@lo:8:kworker.0 00000100:00100000:1.0:1788863867.885915:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863867.885945:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617088 00000100:00100000:1.0:1788863867.885950:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617088 00000100:00100000:1.0:1788863867.885981:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863867.885988:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226617088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.886027:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226617088:12345-0@lo:400:kworker.0 Request processed in 40us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863867.886033:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863867.886052:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617728 00000100:00100000:1.0:1788863867.886056:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617728 00000100:00100000:1.0:1788863867.886106:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617600 00000100:00100000:1.0:1788863867.886110:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617600 00000100:00100000:1.0:1788863867.886122:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863867.886128:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226617728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.886156:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226617728:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863867.886162:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863867.886181:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788863867.886187:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226617600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.886214:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226617600:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863867.886219:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788863867.886236:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226616960 00000100:00100000:1.0:1788863867.886240:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226616960 00000100:00100000:1.0:1788863867.886265:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788863867.886270:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3641:x1875759226616960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.886297:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3641:x1875759226616960:12345-0@lo:400:kworker.0 Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863867.886303:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788863867.886348:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617472 00000100:00100000:1.0:1788863867.886351:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617472 00000100:00100000:1.0:1788863867.886369:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863867.886374:0:18570:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226617472:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788863867.886392:0:18570:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788863867.887803:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226616960:0@lo:400:kworker.0 00010000:00080000:0.0:1788863867.887821:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af58e00 x1875759226617600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863867.887831:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226617600:0@lo:400:kworker.0 00000100:00100000:0.0:1788863867.887842:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226617088:0@lo:400:kworker.0 00010000:00080000:0.0:1788863867.887852:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af59500 x1875759226617728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863867.887859:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226617728:0@lo:400:kworker.0 00000100:00100000:3.0:1788863867.889469:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226617216:0@lo:400:kworker.0 00000100:00100000:3.0:1788863867.889543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863867.889584:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226617856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863867.889605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863867.889629:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863867.889636:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226617344:0@lo:400:kworker.0 00000100:00100000:3.0:1788863867.889661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863867.889694:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617344 00000100:00100000:3.0:1788863867.889701:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617344 00000100:00100000:3.0:1788863867.889746:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788863867.889754:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226617344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863867.889809:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226617344:12345-0@lo:400:kworker.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863867.889816:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788863867.889837:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617216 00000100:00100000:3.0:1788863867.889840:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617216 00000100:00100000:3.0:1788863867.889861:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617856 00000100:00100000:3.0:1788863867.889864:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617856 00000100:00100000:3.0:1788863867.889882:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863867.889887:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226617216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863867.889930:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226617216:12345-0@lo:400:kworker.0 Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863867.889938:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863867.889950:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863867.889955:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226617856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863867.889978:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226617856:12345-0@lo:400:kworker.0 Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863867.889983:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788863867.890001:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863867.890005:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863867.890040:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226617344:0@lo:400:kworker.0 00010000:00080000:3.0:1788863867.890052:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af5a300 x1875759226617216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863867.890061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226617216:0@lo:400:kworker.0 00010000:00080000:3.0:1788863867.890070:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af5bb80 x1875759226617856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863867.890106:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226617856:0@lo:400:kworker.0 00000100:00100000:1.0:1788863867.930509:0:18570:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226617472:12345-0@lo:8:kworker.0 Request processed in 44126us (44585us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863867.930524:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788863867.930731:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863867.930738:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863867.930742:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226617472:0@lo:8:kworker.0 00010000:00010000:2.0:1788863868.142633:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863868.908595:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226617984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863868.908668:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863868.908793:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863848/real 1788863848] req@ffff89e5438ded80 x1875759226608128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863868 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863868.908815:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5438ded80 x1875759226608128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863868 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863868.908825:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863848/real 1788863848] req@ffff89e5438ddf80 x1875759226608256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863868 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863868.908848:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5438ddf80 x1875759226608256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863868 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788863868.908862:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863868.908870:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788863868.908874:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226608128:0@lo:8:kworker.0 00000100:00080000:0.0:1788863868.908880:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863868.908884:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788863868.908888:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226608256:0@lo:8:kworker.0 00000100:00100000:0.0:1788863868.908917:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226617984 00000100:00100000:0.0:1788863868.908925:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226617984 00000100:00100000:0.0:1788863868.908975:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788863868.908985:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226617984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863868.909034:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863868.909102:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226617984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863868.909110:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788863868.909132:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863868.909141:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226618112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863868.909167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863868.909193:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226618112 00000100:00100000:0.0:1788863868.909197:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226618112 00000100:00100000:0.0:1788863868.909220:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863868.909227:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226618112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788863868.909245:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788863868.909279:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226618112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863868.909286:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863868.909336:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226618112:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788863868.910035:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863868.910040:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788863868.910043:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863868.910048:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:0.0:1788863868.910052:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788863868.910060:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e5425b0800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863868.910106:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544004000 x1875759226618368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863868.910122:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863868.910134:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863868.910136:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863868.910139:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:0.0:1788863868.910142:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788863868.910148:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e676341000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863868.910163:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544005180 x1875759226618496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863868.910187:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863868.910190:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863868.910192:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863868.910196:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:0.0:1788863868.910198:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788863868.910203:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e67b6ae000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863868.910214:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544007800 x1875759226618880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863868.910257:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226618240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.910298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863868.910348:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226619136:0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.910374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863868.911182:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226619008:0@lo:400:kworker.0 00000100:00100000:2.0:1788863868.911238:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226618624:0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.911835:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226618240 00000100:00100000:0.0:1788863868.913459:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226618240 00000100:00100000:0.0:1788863868.913522:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863868.913532:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3641:x1875759226618240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.914517:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3641:x1875759226618240:12345-0@lo:400:kworker.0 Request processed in 984us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863868.916285:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226618240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.916406:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863868.916471:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226618752:0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.916525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863868.916922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863868.916957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226619264:0@lo:400:kworker.0 00000100:00100000:2.0:1788863868.916988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863868.917018:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619136 00000100:00100000:2.0:1788863868.917025:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619136 00000100:00100000:2.0:1788863868.917058:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226618624 00000100:00100000:2.0:1788863868.917061:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226618624 00000100:00100000:2.0:1788863868.917097:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619264 00000100:00100000:2.0:1788863868.917112:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619264 00000100:00100000:2.0:1788863868.917132:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863868.917141:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226619136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863868.917191:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226619136:12345-0@lo:400:kworker.0 Request processed in 52us (6816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863868.917198:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863868.917226:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863868.917231:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226618624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863868.917263:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226618624:12345-0@lo:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863868.917269:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863868.917281:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863868.917286:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226619264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863868.917326:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226619264:12345-0@lo:400:kworker.0 Request processed in 40us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863868.917331:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863868.917355:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788863868.917396:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544006a00 x1875759226618624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863868.917408:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226618624:0@lo:400:kworker.0 00010000:00080000:2.0:1788863868.917417:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544004700 x1875759226619264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863868.917425:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226619264:0@lo:400:kworker.0 00000100:00100000:2.0:1788863868.917441:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619008 00000100:00100000:2.0:1788863868.917445:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619008 00000100:00100000:2.0:1788863868.917471:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788863868.917477:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226619008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863868.917510:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226619008:12345-0@lo:400:kworker.0 Request processed in 33us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863868.917516:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788863868.918295:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544007b80 x1875759226619008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863868.918307:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226619008:0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.919501:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226617984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863868.919910:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226618368:0@lo:8:kworker.0 00000100:00100000:0.0:1788863868.919963:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863868.920006:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226618496:0@lo:8:kworker.0 00000100:00100000:0.0:1788863868.920026:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863868.920040:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226618880:0@lo:8:kworker.0 00000100:00100000:0.0:1788863868.920056:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863868.920119:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226618752 00000100:00100000:0.0:1788863868.920126:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226618752 00000100:00100000:0.0:1788863868.920161:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226618368 00000100:00100000:0.0:1788863868.920164:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226618368 00000100:00100000:0.0:1788863868.920174:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226618496 00000100:00100000:0.0:1788863868.920176:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226618496 00000100:00100000:0.0:1788863868.920185:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226618880 00000100:00100000:0.0:1788863868.920187:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226618880 00000100:00100000:0.0:1788863868.920716:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863868.920730:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226618752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.920790:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226618752:12345-0@lo:400:kworker.0 Request processed in 63us (4265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863868.933567:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863868.933584:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226618368:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788863868.933648:0:18570:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788863868.933663:0:18570:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:1.0:1788863868.934152:0:18568:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1788863868.934478:0:18568:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a0f6 00002000:00100000:1.0:1788863868.934496:0:18568:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89e645399800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788863868.934501:0:18568:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788863868.934503:0:18568:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788863868.934650:0:18568:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788863868.938132:0:18568:0:(import.c:65:import_set_state_nolock()) ffff89e64539d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863868.938268:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226618368:12345-0@lo:8:kworker.0 Request processed in 4685us (18301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863868.938281:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863868.938331:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863868.938338:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226618496:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788863868.938359:0:18568:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788863868.938404:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226618496:12345-0@lo:8:kworker.0 Request processed in 65us (18376us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863868.938410:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863868.938423:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863868.938428:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226618880:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788863868.938437:0:18568:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788863868.938460:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226618880:12345-0@lo:8:kworker.0 Request processed in 31us (18403us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863868.938466:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788863868.938518:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544007480 x1875759226619136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863868.938533:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226619136:0@lo:400:kworker.0 00010000:00080000:1.0:1788863868.940188:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544004380 x1875759226618752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863868.940216:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226618752:0@lo:400:kworker.0 00000100:00100000:0.0:1788863868.943092:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788863868.943178:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544004000 x1875759226618368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863868.943191:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863868.943221:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788863868.943229:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788863868.943234:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788863868.943238:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788863868.943269:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788863868.943276:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226618368:0@lo:8:kworker.0 00000100:00080000:0.0:1788863868.943293:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863868.943297:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863868.943300:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226618496:0@lo:8:kworker.0 00000100:00080000:0.0:1788863868.943324:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863868.943328:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863868.943331:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226618880:0@lo:8:kworker.0 00000004:00080000:0.0:1788863868.943431:0:17084:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788863868.943520:0:17084:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 536067443113ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788863868.943526:0:17084:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788863868.944698:0:17085:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788863868.944726:0:17085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17085:1875759226619520:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788863868.944797:0:17085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863868.944827:0:17085:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863868.944965:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619520 00000100:00100000:1.0:1788863868.944973:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619520 00000100:00100000:1.0:1788863868.945030:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863868.945040:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17085:x1875759226619520:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788863868.945641:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863868.945957:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226619392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863868.946006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863868.946050:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619392 00000100:00100000:0.0:1788863868.946056:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619392 00000100:00100000:0.0:1788863868.946109:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863868.946117:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875759226619392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863868.946132:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788863868.946176:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875759226619392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863868.946182:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788863868.946228:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e66d4b9f80 x1875759226619392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863868.946255:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226619392:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788863868.950551:0:17040:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788863868.952869:0:18568:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788863868.952881:0:18568:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788863868.952887:0:18568:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:2.0:1788863868.984044:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863868.984058:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.984089:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788863868.984094:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863868.984100:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.984120:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.984130:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.984139:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.984173:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788863868.985749:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863868.985760:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.985776:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788863868.985780:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863868.985786:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.985799:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.985807:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.985815:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.985833:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788863868.986246:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863868.986253:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986263:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863868.986272:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986282:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986298:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986306:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b87269eb/0xf569beb9d4b6a0fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986337:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863868.986341:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986347:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863868.986351:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986358:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986368:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986375:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073c83f62/0xf569beb9d4b6a104 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.986391:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863868.986392:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863868.986394:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863868.986407:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863868.986994:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863868.987002:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.987013:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788863868.987017:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863868.987022:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.987032:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.987040:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.987046:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.987967:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788863868.990235:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863868.990248:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863868.990265:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863868.990269:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863868.990275:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863868.990302:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863868.990326:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863868.990335:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.990997:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863868.991007:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.991016:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922a00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863868.991020:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.991030:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.991050:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.991057:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c13c95e/0xf569beb9d4b6a10b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.993172:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863868.993183:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.993226:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863868.993231:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.993242:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.993261:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.993270:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863868.993272:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863868.993274:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863868.996151:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788863868.996165:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a112 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863868.997277:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863868.997286:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.997301:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863868.997305:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863868.997325:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.997340:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.997350:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863868.997364:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.997522:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863868.997529:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.997556:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863868.997561:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.997571:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.997588:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863868.997596:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863868.997598:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863868.997600:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863868.999045:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863868.999055:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a119 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.000307:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863869.001553:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863869.001565:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.001582:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788863869.001587:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863869.001594:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.001610:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.001621:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.001645:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.001668:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.001791:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.001798:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.001806:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ee00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.001809:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.001819:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.001834:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.001853:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a120 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.001866:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.001867:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.001869:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863869.002458:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863869.002465:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.002476:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788863869.002480:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863869.002484:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.002495:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.002503:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.002511:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.002531:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.002560:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.002567:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.002581:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.002586:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.002595:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.002609:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.002617:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.002632:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.002635:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.002637:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863869.003723:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863869.003733:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.003754:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788863869.003759:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863869.003764:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.003786:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.003796:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.003804:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.003825:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.003922:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.003928:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.003938:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.003952:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.003969:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.003984:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.003991:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6a12e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.004009:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.004011:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.004012:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863869.004463:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.004470:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.004492:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.004495:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.004500:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.004510:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.004519:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.004527:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.004561:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.004766:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.004772:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.004781:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259aa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.004784:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.004804:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.004817:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.004825:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a135 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.005339:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.005343:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.005345:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863869.005388:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.005395:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.005405:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.005409:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.005413:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.005424:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.005432:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.005439:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.005460:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.005944:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.005950:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.005959:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259be00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.005963:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.005975:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.005989:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.006009:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7f46ab2/0xf569beb9d4b6a13c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.006025:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.006027:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.006029:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863869.006829:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.006837:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.006847:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.006856:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.006861:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.006872:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.006881:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.006889:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.006916:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.007103:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.007110:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007119:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.007124:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007133:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007149:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007161:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f34a4cef/0xf569beb9d4b6a143 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007176:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.007177:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.007179:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788863869.007444:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863869.007451:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007459:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863869.007463:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863869.007467:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007476:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007494:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007501:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007520:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.007743:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.007748:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007755:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.007759:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007766:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007777:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007783:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c264916/0xf569beb9d4b6a14a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.007796:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.007797:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.007799:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788863869.007861:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863869.007866:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007874:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863869.007877:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863869.007881:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007889:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007896:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007903:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.007956:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788863869.008234:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863869.008239:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008247:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863869.008250:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863869.008254:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008262:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008269:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008276:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.008422:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863869.008427:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.008434:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.008438:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.008455:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.008466:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.008472:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc6b715/0xf569beb9d4b6a151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008547:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863869.008554:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863869.008557:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008563:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863869.008571:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008579:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008588:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008595:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aef9ac39/0xf569beb9d4b6a158 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008606:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.008607:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.008626:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.008643:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788863869.008894:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863869.008900:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008907:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863869.008910:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863869.008914:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008922:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008930:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008941:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.008984:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788863869.009417:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863869.009423:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.009431:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863869.009435:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863869.009439:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.009447:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.009455:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.009462:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010108:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788863869.010136:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863869.010143:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010154:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99a00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.010159:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010169:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010183:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010190:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f05f9e9/0xf569beb9d4b6a15f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010240:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863869.010245:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010258:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863869.010261:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010269:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.010274:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.010281:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010288:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c100ec5/0xf569beb9d4b6a166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010304:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.010306:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.010318:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788863869.010647:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863869.010654:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010664:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863869.010667:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863869.010672:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010684:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010700:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010709:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.010732:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.010782:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.010787:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010795:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.010798:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010806:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010818:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010826:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a1e55b9/0xf569beb9d4b6a16d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.010839:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.010841:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.010843:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788863869.011281:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788863869.011288:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.011298:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788863869.011302:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863869.011306:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016021:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016035:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016045:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.016138:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863869.016634:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863869.016642:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016652:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863869.016657:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863869.016663:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.016672:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016681:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.016685:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.016693:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.016700:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016707:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.016712:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016719:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e47e431a/0xf569beb9d4b6a174 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.016742:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.016744:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.016746:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863869.017296:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.017303:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.017334:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863869.017618:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.017624:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.017633:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.017637:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.017641:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.017651:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.017658:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.017665:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.017696:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788863869.017816:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863869.017823:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017831:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.017841:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017849:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017861:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017867:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8201cc8/0xf569beb9d4b6a17b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017883:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.017886:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017891:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.017895:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017901:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017909:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017916:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a182 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.017931:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.017933:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.017934:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.018044:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863869.018574:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.018580:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.018591:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.018594:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.018598:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.018609:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.018617:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.018624:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.019237:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.019288:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.019297:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.019319:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.019325:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.019335:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.019352:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.019360:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a189 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.019377:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.019379:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.019380:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863869.020509:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.020519:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020533:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.020544:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.020550:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020564:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020574:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020582:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020600:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863869.020624:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863869.020632:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.020642:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ae00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863869.020655:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.020664:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.020685:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.020690:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002994947/0xf569beb9d4b6a190 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.020703:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.020704:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.020706:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863869.020885:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863869.020891:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020899:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1788863869.020902:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863869.020906:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020914:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020922:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020934:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863869.020956:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.021008:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.021015:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.021036:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259bc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.021039:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.021047:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.021058:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.021064:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cadc01/0xf569beb9d4b6a197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.021104:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.021105:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.021107:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863869.021329:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863869.021336:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.021346:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788863869.021349:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863869.021353:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.021363:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.021377:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.021384:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.021407:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863869.021587:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863869.021594:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.021603:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863869.021607:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.021616:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.021627:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.021713:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6a19e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.021787:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.021789:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.021791:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863869.022444:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863869.022451:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.022464:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788863869.022468:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863869.022473:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.022485:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.022493:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.022500:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.022574:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863869.022710:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863869.022716:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.022725:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ee00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863869.022729:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.022738:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.022756:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.022764:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6a1a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863869.022780:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.022781:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863869.022783:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863869.023128:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863869.023139:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023150:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788863869.023153:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863869.023158:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023167:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023175:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023182:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023203:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863869.023407:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863869.023414:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023424:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863869.023428:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023437:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023451:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023459:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6a1ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023478:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.023480:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.023482:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863869.023487:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863869.023494:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023503:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788863869.023512:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863869.023516:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023525:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023533:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023540:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863869.023564:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788863869.023592:0:18568:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:3.0:1788863869.023630:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863869.023636:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023646:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863869.023650:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023660:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023673:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863869.023682:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6a1b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863869.023689:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17085:x1875759226619520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 78646us (78887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863869.023701:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788863869.023703:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.023706:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.023708:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863869.024042:0:17085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17085:1875759226619520:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788863869.024364:0:17085:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788863869.024455:0:17085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17085:1875759226619648:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788863869.024493:0:17085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863869.024561:0:17085:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863869.024594:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619648 00000100:00100000:2.0:1788863869.024600:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619648 00000100:00100000:2.0:1788863869.024647:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863869.024655:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17085:x1875759226619648:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788863869.024689:0:19251:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1788863869.030271:0:18564:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788863869.030335:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788863869.030776:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17085:x1875759226619648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6117us (6278us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788863869.030789:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788863869.030821:0:17085:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788863869.030831:0:17085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17085:1875759226619648:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788863869.030845:0:17085:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788863869.167287:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788863869.680909:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788863870.187247:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863871.218378:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788863872.211010:0:19381:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788863872.211015:0:19381:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788863872.211017:0:19381:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788863872.211225:0:19381:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e5425b8000 00000020:01000004:2.0:1788863872.211256:0:19381:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788863872.211276:0:19381:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788863872.211308:0:19381:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89e542b699c0) 00000020:00000080:2.0:1788863872.211334:0:19381:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788863872.236238:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788863872.302409:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788863872.304159:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788863872.304645:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788863872.304933:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788863872.305337:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788863872.305917:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788863872.306258:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788863872.312956:0:19381:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788863872.314504:0:19381:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788863872.314525:0:19381:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788863872.315517:0:19381:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf569beb9d4b6a1c1 00000020:01000004:2.0:1788863872.315529:0:19381:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788863872.315569:0:19381:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788863872.315582:0:19381:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788863872.315590:0:19381:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788863872.315626:0:19381:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788863872.315630:0:19381:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788863872.350526:0:19381:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788863872.350588:0:19381:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.135@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788863872.350594:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788863872.350596:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788863872.350598:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863872.350600:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863872.350601:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863872.350602:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863872.350604:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863872.350607:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863872.350608:0:19381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788863872.350613:0:19381:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788863872.350615:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788863872.350616:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788863872.350617:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863872.350619:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863872.350619:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863872.350620:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863872.350621:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863872.350623:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863872.350624:0:19381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788863872.350662:0:19381:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788863872.350691:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226619776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788863872.350804:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863872.350873:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d503b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863872.351919:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619776 00000100:00100000:0.0:1788863872.351933:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619776 00000100:00100000:0.0:1788863872.352018:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863872.352030:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:19381:x1875759226619776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863872.352126:0:17053:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788863872.352131:0:17053:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788863872.352136:0:17053:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788863872.353986:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:19381:x1875759226619776:12345-0@lo:253:mount.lustre.0 Request processed in 1948us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863872.354004:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863872.356200:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226619776:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788863872.356231:0:19381:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788863872.356235:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788863872.356238:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863872.356240:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863872.356252:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863872.356254:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863872.356255:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863872.356258:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863872.356260:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863872.356262:0:19381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788863872.356432:0:19381:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e5425b8000 from lustre-OST0001 10000000:01000000:0.0:1788863872.356482:0:19381:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788863872.356485:0:19381:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788863872.356497:0:19381:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e5428e99c0 local copy 00010000:00010000:0.0:1788863872.356528:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863872.356703:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226619904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863872.356786:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.356853:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863872.357588:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226619904 00000100:00100000:2.0:1788863872.357602:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226619904 00000100:00100000:2.0:1788863872.357672:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788863872.357683:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:19381:x1875759226619904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863872.357809:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:19381:x1875759226619904:12345-0@lo:501:mount.lustre.0 Request processed in 127us (1022us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863872.357817:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863872.359421:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226619904:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788863872.359463:0:19381:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788863872.359518:0:19381:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788863872.359531:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863872.359544:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863872.359594:0:19381:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e5425b8000 10000000:01000000:0.0:1788863872.359601:0:19381:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788863872.359609:0:19381:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788863872.359612:0:19381:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863872.359619:0:19381:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788863872.359622:0:19381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788863872.359670:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863872.359679:0:19381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863872.359692:0:19381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863872.359744:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788863872.359820:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.360656:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863872.362048:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620032 00000100:00100000:2.0:1788863872.362354:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620032 00000100:00100000:2.0:1788863872.362520:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788863872.362534:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:19381:x1875759226620032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863872.362559:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863872.362586:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650923a00/0xf569beb9d4b6a1cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a1c8 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863872.362625:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650923a00/0xf569beb9d4b6a1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a1c8 expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863872.362637:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650923a00/0xf569beb9d4b6a1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a1c8 expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863872.362647:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650923a00, rc 0) 00000100:00100000:2.0:1788863872.362830:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620032:12345-0@lo:101:mount.lustre.0 Request processed in 299us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863872.362838:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788863872.364927:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863872.364972:0:19381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.364988:0:19381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863872.367626:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788863872.371034:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863872.376738:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788863872.376821:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788863872.376838:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788863872.376854:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788863872.376869:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788863872.376883:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788863872.376935:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788863872.376943:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788863872.377490:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863872.377697:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.377764:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863872.377844:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620160 00000100:00100000:3.0:1788863872.377853:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620160 00000100:00100000:3.0:1788863872.377970:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788863872.377981:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863872.378226:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620160:12345-0@lo:501:mount.lustre.0 Request processed in 246us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.378234:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788863872.378354:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863872.378407:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863872.378469:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.378846:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863872.378948:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620288 00000100:00100000:0.0:1788863872.378955:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620288 00000100:00100000:0.0:1788863872.378992:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788863872.378999:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863872.383573:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620288:12345-0@lo:503:mount.lustre.0 Request processed in 4566us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863872.383594:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788863872.383647:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620288:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863872.384316:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863872.384438:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863872.384533:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.384597:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66242c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863872.386517:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620416 00000100:00100000:3.0:1788863872.386536:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620416 00000100:00100000:3.0:1788863872.386621:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788863872.386634:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863872.387385:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620416:12345-0@lo:502:mount.lustre.0 Request processed in 750us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.387397:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788863872.390647:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788863872.392167:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788863872.392223:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788863872.392252:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788863872.392270:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788863872.392283:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788863872.392295:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788863872.392305:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788863872.392317:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788863872.392347:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788863872.392399:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863872.392477:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.392535:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ec8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863872.396892:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620544 00000100:00100000:2.0:1788863872.396908:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620544 00000100:00100000:2.0:1788863872.396988:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788863872.396999:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863872.397273:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620544:12345-0@lo:502:mount.lustre.0 Request processed in 275us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863872.397281:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788863872.397366:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863872.397522:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788863872.397542:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788863872.398652:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788863872.398664:0:19385:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788863872.398672:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863872.398675:0:19385:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788863872.398682:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788863872.398766:0:19385:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89e543a1cd40) 00000020:00000080:3.0:1788863872.398803:0:19385:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788863872.398812:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788863872.400046:0:19385:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5425b8000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788863872.401236:0:19385:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788863872.401295:0:19385:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf569beb9d4b6a1dd 00010000:00010000:3.0:1788863872.415541:0:19385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788863872.420787:0:19385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788863872.424296:0:19385:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788863872.435118:0:19385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788863872.435327:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863872.435337:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.435339:0:19385:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788863872.435352:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863872.435357:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.435358:0:19385:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788863872.435362:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788863872.435364:0:19385:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788863872.435367:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863872.435369:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.435371:0:19385:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788863872.435373:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863872.435376:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.435377:0:19385:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788863872.435381:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788863872.435424:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863872.435428:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.435429:0:19385:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788863872.435433:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788863872.436310:0:19381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788863872.436357:0:19381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788863872.436385:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.436400:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863872.436409:0:19381:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5425b8000 from 1 10000000:01000000:1.0:1788863872.436413:0:19381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863872.436461:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.436469:0:19381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.436480:0:19381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863872.436536:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863872.436625:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.436681:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66242c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788863872.438833:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620672 00000100:00100000:3.0:1788863872.438853:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620672 00000100:00100000:3.0:1788863872.438931:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788863872.438951:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:19381:x1875759226620672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863872.438978:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863872.439001:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a1e4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863872.439036:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863872.439049:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863872.439059:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98400, rc 0) 00000100:00100000:3.0:1788863872.439189:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226620672:12345-0@lo:101:mount.lustre.0 Request processed in 240us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.439198:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788863872.439532:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863872.439558:0:19381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.439569:0:19381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863872.448912:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788863872.449440:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863872.449699:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788863872.449728:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788863872.449745:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788863872.449750:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788863872.449860:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863872.449953:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863872.451380:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863872.458018:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620800 00000100:00100000:0.0:1788863872.458061:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620800 00000100:00100000:0.0:1788863872.458178:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788863872.458189:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226620800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863872.458435:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226620800:12345-0@lo:501:mount.lustre.0 Request processed in 247us (8481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863872.458444:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788863872.458862:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863872.458934:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863872.459001:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863872.459047:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863872.459358:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226620928 00000100:00100000:0.0:1788863872.459365:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226620928 00000100:00100000:0.0:1788863872.459411:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788863872.459420:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226620928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863872.459549:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226620928:12345-0@lo:503:mount.lustre.0 Request processed in 128us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863872.459557:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788863872.459735:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226620928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788863872.460641:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863872.460752:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863872.460831:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863872.460929:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788863872.460971:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621056 00000100:00100000:1.0:1788863872.460979:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621056 00000100:00100000:1.0:1788863872.461117:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788863872.461128:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226621056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863872.461272:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226621056:12345-0@lo:502:mount.lustre.0 Request processed in 146us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.461280:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788863872.461375:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788863872.461621:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788863872.461651:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788863872.461668:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788863872.461684:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788863872.461700:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788863872.461715:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788863872.461728:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788863872.461741:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788863872.461756:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788863872.461772:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788863872.461788:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788863872.461820:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863872.461866:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863872.462573:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863872.462695:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621184 00000100:00100000:0.0:1788863872.462703:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621184 00000100:00100000:0.0:1788863872.462751:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788863872.462761:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226621184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863872.462914:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226621184:12345-0@lo:502:mount.lustre.0 Request processed in 154us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863872.462921:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788863872.463041:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788863872.463616:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788863872.463645:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788863872.465881:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863872.465898:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.465901:0:19389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788863872.465916:0:19389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5425b8000 00000020:00000080:2.0:1788863872.465919:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863872.465929:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863872.465931:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.465933:0:19389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788863872.465935:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863872.465938:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.465939:0:19389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788863872.465943:0:19389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5425b8000 00000020:00000080:2.0:1788863872.465945:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863872.466024:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863872.466028:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.466030:0:19389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788863872.466033:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863872.466036:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.466037:0:19389:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788863872.466041:0:19389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5425b8000 00000020:00000080:2.0:1788863872.466043:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863872.466062:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863872.466064:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.467580:0:19389:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788863872.467604:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863872.467612:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.467614:0:19389:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788863872.467620:0:19389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5425b8000 00000020:00000080:2.0:1788863872.467623:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863872.467701:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863872.467705:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863872.467706:0:19389:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788863872.467711:0:19389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788863872.467991:0:19381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788863872.468033:0:19381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788863872.468061:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.468107:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863872.468190:0:19381:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788863872.468199:0:19381:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e5425b8000 10000000:01000000:1.0:1788863872.468202:0:19381:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e5425b8000 10000000:01000000:1.0:1788863872.468208:0:19381:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863872.468215:0:19381:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e5425b8000 from 1 10000000:01000000:1.0:1788863872.468218:0:19381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863872.468279:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.468289:0:19381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.468303:0:19381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863872.468337:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863872.468428:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.468655:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621312 00000100:00100000:1.0:1788863872.468665:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621312 00000100:00100000:1.0:1788863872.468723:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863872.468734:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:19381:x1875759226621312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863872.468753:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863872.468770:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3ea00/0xf569beb9d4b6a1f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a1f2 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.468802:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3ea00/0xf569beb9d4b6a1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a1f2 expref: 24 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.468813:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3ea00/0xf569beb9d4b6a1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a1f2 expref: 24 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.468836:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ea00, rc 0) 00000100:00100000:1.0:1788863872.468878:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621312:12345-0@lo:101:mount.lustre.0 Request processed in 146us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.468884:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863872.468952:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863872.468979:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863872.468998:0:19381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.469008:0:19381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863872.473733:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788863872.475706:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863872.478182:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788863872.478762:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788863872.478815:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788863872.478846:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788863872.478863:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788863872.478893:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788863872.487842:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788863872.487888:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788863872.487901:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788863872.487913:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788863872.488006:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788863872.488020:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788863872.488031:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788863872.488043:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788863872.488066:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788863872.488096:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788863872.488112:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788863872.488125:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788863872.488136:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788863872.488151:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788863872.488163:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788863872.488175:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788863872.488204:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788863872.488219:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788863872.488232:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788863872.488259:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788863872.488273:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788863872.488285:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788863872.488299:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788863872.488312:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788863872.488414:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788863872.488436:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788863872.488449:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788863872.488461:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788863872.488476:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788863872.488568:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788863872.488586:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788863872.488600:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788863872.488627:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788863872.488641:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788863872.488652:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788863872.488665:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788863872.488680:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788863872.488693:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788863872.488706:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788863872.488718:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788863872.488748:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788863872.488761:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788863872.489612:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863872.489714:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.489788:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863872.490722:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621440 00000100:00100000:3.0:1788863872.490736:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621440 00000100:00100000:3.0:1788863872.490804:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788863872.490814:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863872.491037:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621440:12345-0@lo:501:mount.lustre.0 Request processed in 223us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.491045:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788863872.502229:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863872.502340:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863872.502441:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.502501:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863872.502583:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621568 00000100:00100000:0.0:1788863872.502592:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621568 00000100:00100000:0.0:1788863872.502666:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788863872.502677:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863872.502823:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621568:12345-0@lo:503:mount.lustre.0 Request processed in 147us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863872.502840:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788863872.503612:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863872.505804:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863872.505947:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863872.506102:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863872.507306:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621696 00000100:00100000:3.0:1788863872.507322:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621696 00000100:00100000:3.0:1788863872.507391:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788863872.507404:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863872.507841:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863872.507936:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621696:12345-0@lo:502:mount.lustre.0 Request processed in 534us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.507953:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788863872.508064:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863872.508938:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788863872.508975:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788863872.508991:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788863872.509005:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788863872.509019:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788863872.509054:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788863872.509108:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788863872.509125:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788863872.509979:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788863872.510000:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788863872.510011:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788863872.510022:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788863872.510033:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788863872.510053:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788863872.510574:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788863872.510607:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788863872.510621:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788863872.510634:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788863872.510644:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788863872.510655:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788863872.510666:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788863872.510701:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788863872.510719:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788863872.510734:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788863872.510746:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788863872.510759:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788863872.510771:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788863872.510782:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788863872.510795:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788863872.510807:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788863872.510819:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788863872.510830:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788863872.510843:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788863872.510856:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788863872.510869:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788863872.510884:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788863872.510898:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788863872.510927:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788863872.510944:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788863872.510956:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788863872.510969:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788863872.510983:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788863872.510995:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788863872.511009:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788863872.511023:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788863872.511036:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788863872.511061:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788863872.512499:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788863872.512591:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863872.512706:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.512875:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863872.516457:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621824 00000100:00100000:3.0:1788863872.516481:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621824 00000100:00100000:3.0:1788863872.517390:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788863872.517405:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863872.517700:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621824:12345-0@lo:502:mount.lustre.0 Request processed in 298us (4994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.517709:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788863872.517886:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863872.518376:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788863872.518410:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788863872.518453:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863872.518759:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863872.518837:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65015ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863872.518870:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226621952 00000100:00100000:1.0:1788863872.518879:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226621952 00000100:00100000:1.0:1788863872.518956:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788863872.518966:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863872.519173:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226621952:12345-0@lo:502:mount.lustre.0 Request processed in 208us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.519180:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788863872.519290:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226621952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788863872.519356:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788863872.519369:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788863872.521579:0:19394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788863872.521604:0:19394:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89e65d58cd40) 00000020:00000080:3.0:1788863872.521635:0:19394:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788863872.521741:0:19394:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5425b8000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788863872.521746:0:19394:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5425b8000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788863872.521749:0:19394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5425b8000 3 00010000:00080000:3.0:1788863872.521794:0:19394:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e5448e6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788863872.526754:0:19394:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788863872.527068:0:19394:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788863872.527435:0:19394:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863872.527454:0:19394:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf569beb9d4b6a207 00000100:00080000:2.0:1788863872.527468:0:19394:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863872.527483:0:19394:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e5448e6000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863872.527532:0:19394:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543b7b800 x1875759226622080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863872.527607:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226622080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788863872.527700:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788863872.527781:0:19394:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788863872.533281:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622080 00000100:00100000:3.0:1788863872.533303:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622080 00000100:00100000:3.0:1788863872.533378:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863872.533389:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226622080:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788863872.533430:0:17060:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1788863872.533479:0:17060:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf569beb9d4b6a20e 00000004:00100000:3.0:1788863872.533501:0:17060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788863872.533544:0:17060:0:(import.c:65:import_set_state_nolock()) ffff89e5448e2000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788863872.533789:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863872.533794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788863872.533798:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863872.533804:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1788863872.533809:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788863872.533818:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e676341000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863872.533840:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e681ca9c00 x1875759226622464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863872.533891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863872.533894:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788863872.533896:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863872.533900:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1788863872.533903:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788863872.533907:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e67b6ae000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863872.533917:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e681ca9180 x1875759226622976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863872.533963:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226622208:0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.534009:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.534047:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226622848:0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.534069:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.535295:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226622720:0@lo:400:kworker.0 00000100:00100000:0.0:1788863872.535362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.535395:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226623360:0@lo:400:kworker.0 00000100:00100000:0.0:1788863872.535415:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.535439:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788863872.535445:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226622592:0@lo:400:kworker.0 00000100:00100000:0.0:1788863872.535465:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.535485:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226623232:0@lo:400:kworker.0 00000100:00100000:0.0:1788863872.535505:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.535624:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622208 00000100:00100000:0.0:1788863872.535633:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622208 00000100:00100000:3.0:1788863872.535730:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875759226622080:12345-0@lo:38:llog_process_th.0 Request processed in 2340us (8029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.535752:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863872.535775:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226623360 00000100:00100000:3.0:1788863872.535778:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226623360 00000100:00100000:3.0:1788863872.535811:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622592 00000100:00100000:3.0:1788863872.535813:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622592 00000100:00100000:3.0:1788863872.535839:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226623232 00000100:00100000:3.0:1788863872.535842:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226623232 00000100:00100000:3.0:1788863872.535857:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788863872.535865:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226623360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863872.536250:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226623360:12345-0@lo:400:kworker.0 Request processed in 374us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.536258:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788863872.536272:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863872.536278:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226622592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863872.536317:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226622592:12345-0@lo:400:kworker.0 Request processed in 39us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.536323:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863872.536333:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863872.536338:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226623232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863872.536360:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226623232:12345-0@lo:400:kworker.0 Request processed in 22us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863872.536365:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788863872.536383:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863872.536388:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863872.536497:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788863872.536507:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226622336:0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.536538:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.536556:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226623104:0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.536573:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.536605:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622720 00000100:00100000:1.0:1788863872.536610:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622720 00000100:00100000:1.0:1788863872.536641:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788863872.536646:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226622720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.536677:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226622720:12345-0@lo:400:kworker.0 Request processed in 31us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.536683:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788863872.536712:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622848 00000100:00100000:1.0:1788863872.536715:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622848 00000100:00100000:1.0:1788863872.536748:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622336 00000100:00100000:1.0:1788863872.536750:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622336 00000100:00100000:1.0:1788863872.536769:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863872.536775:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226622848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.536811:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226622848:12345-0@lo:400:kworker.0 Request processed in 36us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.536818:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863872.536828:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863872.536833:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226622336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.536857:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226622336:12345-0@lo:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.536861:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863872.536913:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226622336:0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.536931:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226622848:0@lo:400:kworker.0 00000100:00080000:1.0:1788863872.536953:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863872.536962:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226623104 00000100:00100000:1.0:1788863872.536966:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226623104 00000100:00100000:1.0:1788863872.536984:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863872.536989:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226623104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.537023:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226623104:12345-0@lo:400:kworker.0 Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.537028:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788863872.537052:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681cab100 x1875759226623104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863872.537103:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226623104:0@lo:400:kworker.0 00000100:00100000:0.0:1788863872.538474:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863872.538495:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226622208:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788863872.538603:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543b7b800 x1875759226622080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863872.538615:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863872.538625:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788863872.538635:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788863872.538641:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788863872.538645:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788863872.538653:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226622080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788863872.538693:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226622464:0@lo:8:kworker.0 00010000:00080000:0.0:1788863872.544362:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681ca9f80 x1875759226622592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863872.544389:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226622592:0@lo:400:kworker.0 00010000:00080000:0.0:1788863872.544406:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681ca9880 x1875759226623232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863872.544415:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226623232:0@lo:400:kworker.0 00000100:00100000:0.0:1788863872.544442:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226622720:0@lo:400:kworker.0 00010000:00080000:0.0:1788863872.544455:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e681caad80 x1875759226623360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863872.544463:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226623360:0@lo:400:kworker.0 00000100:00100000:0.0:1788863872.544586:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226622208:12345-0@lo:400:kworker.0 Request processed in 6100us (10574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863872.544599:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000020:01000004:0.0:1788863872.545743:0:19394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788863872.545764:0:19394:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff89e66c64b380) 00000020:00000080:0.0:1788863872.545794:0:19394:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788863872.545914:0:19394:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5425b8000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788863872.545919:0:19394:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5425b8000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788863872.545922:0:19394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5425b8000 3 00010000:00080000:0.0:1788863872.545964:0:19394:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e541eb6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.135@tcp at head 00000100:00100000:1.0:1788863872.547544:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226622208:0@lo:400:kworker.0 00000100:00100000:1.0:1788863872.547652:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863872.548751:0:19394:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788863872.549002:0:19394:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788863872.549065:0:19394:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788863872.549109:0:19394:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf569beb9d4b6a21c 00000100:00080000:0.0:1788863872.549122:0:19394:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00100000:1.0:1788863872.549363:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226622976:0@lo:8:kworker.0 00000100:00100000:1.0:1788863872.549430:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788863872.549460:0:19394:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89e541eb6800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863872.549502:0:19394:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544004380 x1875759226623488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863872.549522:0:19394:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1788863872.552289:0:19394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788863872.552433:0:19381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788863872.552469:0:19381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788863872.552501:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863872.552515:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788863872.552574:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788863872.552577:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863872.552579:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863872.552580:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863872.552581:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863872.552582:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863872.552584:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863872.552586:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863872.552588:0:19381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788863872.552593:0:19381:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788863872.552595:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863872.552597:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863872.552598:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863872.552599:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863872.552600:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863872.552601:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863872.552602:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863872.552603:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863872.552604:0:19381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788863872.552642:0:19381:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788863872.552669:0:19381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226623616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788863872.552762:0:19381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863872.552817:0:19381:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6452cc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863872.552851:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226623616 00000100:00100000:0.0:1788863872.552861:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226623616 00000100:00100000:0.0:1788863872.552919:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788863872.552927:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226623616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863872.552964:0:17053:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788863872.552987:0:17053:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788863872.555487:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226623488:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788863872.555578:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.555610:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226623488 00000100:00100000:1.0:1788863872.555619:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226623488 00000100:00100000:1.0:1788863872.555661:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863872.555668:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226623488:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788863872.555704:0:17060:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1788863872.555747:0:17060:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf569beb9d4b6a223 00000004:00100000:1.0:1788863872.555764:0:17060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788863872.555810:0:17060:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863872.555861:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875759226623488:12345-0@lo:38:llog_process_th.0 Request processed in 192us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.555868:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788863872.555926:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544004380 x1875759226623488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863872.555938:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863872.555948:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788863872.555956:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788863872.555961:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788863872.555963:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e541eb6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788863872.555969:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226623488:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788863872.559401:0:17053:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788863872.559419:0:17053:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788863872.559475:0:17076:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788863872.559481:0:17076:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788863872.559509:0:17076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.559532:0:17076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 24 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.559541:0:17076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 24 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.559549:0:17076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.559601:0:17076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 24 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.559636:0:17076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 24 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863872.559655:0:17076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226623744:0@lo:104: 00000100:00100000:1.0:1788863872.559741:0:17076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863872.559804:0:17076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 24 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.559813:0:17076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 24 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863872.559821:0:17076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226623872:0@lo:104: 00000100:00100000:1.0:1788863872.559843:0:17076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.559872:0:17076:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5438e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788863872.560053:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226623744 00000100:00100000:1.0:1788863872.560200:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226623744 00000100:00100000:1.0:1788863872.560259:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226623872 00000100:00100000:1.0:1788863872.560263:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226623872 00000100:00100000:1.0:1788863872.560281:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863872.560290:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:17076:x1875759226623744:12345-0@lo:104: 00010000:00010000:1.0:1788863872.560306:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560379:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863872.560386:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:17076:x1875759226623744:12345-0@lo:104: Request processed in 96us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.560400:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863872.560420:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863872.560441:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226623872:12345-0@lo:104: 00010000:00010000:1.0:1788863872.560456:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560494:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788863872.560506:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:17076:x1875759226623872:12345-0@lo:104: Request processed in 66us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.560513:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863872.560604:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:19381:x1875759226623616:12345-0@lo:253:mount.lustre.0 Request processed in 7676us (7842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.560613:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788863872.560673:0:17076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226623744:0@lo:104: 00000100:00100000:1.0:1788863872.560683:0:17076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17076:1875759226623872:0@lo:104: 00010000:00010000:1.0:1788863872.560706:0:17076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560728:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863872.560734:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560742:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fe00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863872.560747:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560755:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863872.560763:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863872.560778:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863872.560816:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560823:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863872.560846:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560853:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3fe00/0xf569beb9d4b6a0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a0e8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560866:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863872.560869:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560874:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788863872.560877:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560883:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863872.560889:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863872.560893:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863872.560904:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560908:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863872.560920:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560926:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650923000/0xf569beb9d4b6a0d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a0da expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.560941:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863872.560943:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863872.560944:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863872.560951:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863872.560965:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226624000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863872.560997:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863872.561023:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863872.561027:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226624128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863872.561043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863872.561602:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622464 00000100:00100000:3.0:1788863872.561613:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622464 00000100:00100000:0.0:1788863872.561701:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226622976 00000100:00100000:0.0:1788863872.561705:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226622976 00000100:00100000:3.0:1788863872.564816:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863872.564842:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3639:x1875759226622464:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788863872.564985:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3639:x1875759226622464:12345-0@lo:8:kworker.0 Request processed in 145us (17332us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788863872.564992:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863872.565011:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863872.565016:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3639:x1875759226622976:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788863872.565044:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3639:x1875759226622976:12345-0@lo:8:kworker.0 Request processed in 27us (15615us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788863872.565049:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863872.565216:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624000 00000100:00100000:1.0:1788863872.565227:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624000 00010000:00010000:1.0:1788863872.565278:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 24 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863872.565312:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624128 00000100:00100000:1.0:1788863872.565315:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624128 00010000:00010000:1.0:1788863872.565329:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 25 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863872.565352:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863872.565359:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+25:3640:x1875759226624000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863872.565375:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863872.565382:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 25 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565409:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 25 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565431:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a0e1 expref: 25 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565448:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863872.565490:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3640:x1875759226624000:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (4493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.565497:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863872.565513:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863872.565518:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:3640:x1875759226624128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863872.565527:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863872.565531:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 23 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565539:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 23 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565548:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6a0da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a0d3 expref: 23 pid: 17054 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565560:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565569:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788863872.565586:0:17045:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006106241s 00010000:00010000:1.0:1788863872.565597:0:17045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565604:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565611:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565619:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565626:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863872.565631:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565640:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565655:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.565667:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863872.565692:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:3640:x1875759226624128:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (4647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863872.565698:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863872.565816:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788863872.565827:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863872.565832:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788863872.565836:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226622464:0@lo:8:kworker.0 00000100:00100000:2.0:1788863872.565855:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788863872.565858:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863872.565862:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788863872.565865:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226622976:0@lo:8:kworker.0 00000100:00100000:0.0:1788863872.566017:0:19381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dea3065e-0e63-4370-a87c-9d4f07265d5e:19381:1875759226623616:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788863872.566032:0:19381:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788863872.566036:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788863872.566038:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863872.566040:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863872.566041:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863872.566042:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863872.566044:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863872.566045:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863872.566047:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863872.566049:0:19381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788863872.566062:0:19381:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788863872.568548:0:19381:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788863872.568850:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226624128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863872.568866:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226624000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863872.568910:0:17076:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.568939:0:17076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863872.568947:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6a22a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788863872.574012:0:19381:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788863872.574029:0:19381:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788863872.574575:0:19381:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788863872.574635:0:19381:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788863872.574656:0:19381:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788863872.574683:0:19381:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788863872.576984:0:19381:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863872.580478:0:19381:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788863873.007111:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863873.007150:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226624256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863873.007248:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863873.007303:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624256 00000100:00100000:3.0:1788863873.007323:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624256 00000100:00100000:3.0:1788863873.007381:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863873.007390:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226624256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863873.007430:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788863873.007484:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226624256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863873.007491:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863873.007551:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226624256:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788863873.259514:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863874.035145:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226624512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863874.035266:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863874.035346:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226624384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863874.035379:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863874.035433:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624384 00000100:00100000:1.0:1788863874.035442:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624384 00000100:00100000:3.0:1788863874.035525:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624512 00000100:00100000:3.0:1788863874.035533:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624512 00000100:00100000:3.0:1788863874.035590:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863874.035601:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226624512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863874.035649:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788863874.035656:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863874.035673:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226624384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863874.035709:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788863874.035727:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226624512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863874.035735:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788863874.035746:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226624384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863874.035752:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788863874.035772:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863874.035819:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226624384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863874.035856:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226624512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863874.053548:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863874.053581:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226624640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863874.053688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863874.053854:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624640 00000100:00100000:2.0:1788863874.053864:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624640 00000100:00100000:2.0:1788863874.053937:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863874.053949:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226624640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788863874.053995:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788863874.054060:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226624640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863874.054069:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863874.054402:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226624640:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788863874.228702:0:19448:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788863874.229006:0:19448:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788863874.285052:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788863874.348813:0:17058:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788863874.348833:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5425c9800 from 10 10000000:01000000:2.0:1788863874.348842:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863874.348910:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863874.348997:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863874.349012:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863874.349048:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226624768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863874.349165:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863874.349238:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863874.349282:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624768 00000100:00100000:3.0:1788863874.349293:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624768 00000100:00100000:3.0:1788863874.349358:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788863874.349370:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:17058:x1875759226624768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863874.349388:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863874.349408:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b6a238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a231 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863874.349440:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b6a238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a231 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863874.349451:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b6a238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a231 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863874.349462:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99e00, rc 0) 00000100:00100000:3.0:1788863874.349512:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226624768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863874.349520:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788863874.349576:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226624768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863874.349592:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863874.349603:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863874.349795:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226624896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788863874.350355:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863874.350637:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e646390d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863874.351726:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226624896 00000100:00100000:0.0:1788863874.351740:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226624896 00000100:00100000:0.0:1788863874.351900:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788863874.351913:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226624896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788863874.351950:0:17053:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788863874.351991:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788863874.351995:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788863874.352392:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226624896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 481us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863874.352402:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788863874.352517:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226624896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788863874.352606:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863874.352618:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863874.352631:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863874.352700:0:17058:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788863874.352705:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e5448c2800 from 10 10000000:01000000:3.0:1788863874.352709:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788863874.352752:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863874.352760:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863874.352771:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863874.352796:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226625024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863874.352845:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863874.352888:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6463900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863874.356462:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625024 00000100:00100000:0.0:1788863874.356533:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625024 00000100:00100000:0.0:1788863874.356611:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788863874.356623:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226625024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863874.356648:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863874.356672:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a23f expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863874.356710:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a23f expref: 24 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863874.356724:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a23f expref: 24 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863874.356736:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259be00, rc 0) 00000100:00100000:0.0:1788863874.356845:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226625024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863874.356853:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863874.357771:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226625024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863874.357802:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863874.357816:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863874.357918:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226625152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788863874.358050:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863874.358482:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b7e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863874.364792:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625152 00000100:00100000:0.0:1788863874.364813:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625152 00000100:00100000:0.0:1788863874.364883:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788863874.364894:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226625152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788863874.365248:0:17053:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788863874.365272:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788863874.365279:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788863874.365442:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226625152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 550us (7392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863874.365452:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788863874.365530:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226625152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788863874.365614:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788863874.370369:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863874.370395:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863875.308350:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788863875.628192:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788863876.359746:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.425457:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863877.617514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863877.617522:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863877.617526:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863877.617548:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e676341000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863877.617576:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af5a300 x1875759226625664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863877.617618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863877.617621:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863877.617623:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863877.617630:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e67b6ae000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863877.617641:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af58e00 x1875759226626176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863877.617746:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226625536:0@lo:400:kworker.0 00000100:00100000:0.0:1788863877.617838:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.617879:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226626304:0@lo:400:kworker.0 00000100:00100000:0.0:1788863877.617909:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.617927:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226626816:0@lo:400:kworker.0 00000100:00100000:0.0:1788863877.617955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.617981:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788863877.617986:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226625792:0@lo:400:kworker.0 00000100:00100000:0.0:1788863877.618008:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.618023:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226626432:0@lo:400:kworker.0 00000100:00100000:0.0:1788863877.618043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.618188:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226625280:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618238:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.618283:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226625920:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.618345:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226626560:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.618384:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788863877.618389:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226625408:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.618439:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226626048:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618461:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.618478:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226626688:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.618527:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626304 00000100:00100000:1.0:1788863877.618538:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626304 00000100:00100000:1.0:1788863877.618581:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626816 00000100:00100000:1.0:1788863877.618584:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626816 00000100:00100000:1.0:1788863877.618611:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625792 00000100:00100000:1.0:1788863877.618614:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625792 00000100:00100000:1.0:1788863877.618626:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626432 00000100:00100000:1.0:1788863877.618628:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626432 00000100:00100000:1.0:1788863877.618646:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626560 00000100:00100000:1.0:1788863877.618648:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626560 00000100:00100000:1.0:1788863877.618660:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626688 00000100:00100000:1.0:1788863877.618662:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626688 00000100:00100000:1.0:1788863877.618678:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863877.618687:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226626304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618751:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226626304:12345-0@lo:400:kworker.0 Request processed in 64us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.618771:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863877.618791:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863877.618796:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226626816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618826:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226626816:12345-0@lo:400:kworker.0 Request processed in 31us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.618832:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863877.618842:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863877.618846:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226625792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618869:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226625792:12345-0@lo:400:kworker.0 Request processed in 22us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.618874:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863877.618884:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788863877.618889:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226626432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618913:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226626432:12345-0@lo:400:kworker.0 Request processed in 24us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.618919:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788863877.618928:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863877.618932:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226626560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.618959:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226626560:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.618965:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863877.618976:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788863877.618981:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226626688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.619005:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226626688:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.619017:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788863877.619040:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625920 00000100:00100000:1.0:1788863877.619045:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625920 00000100:00100000:1.0:1788863877.619068:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625408 00000100:00100000:1.0:1788863877.619071:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625408 00000100:00100000:0.0:1788863877.619252:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625280 00000100:00100000:0.0:1788863877.619257:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625280 00000100:00100000:0.0:1788863877.619289:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788863877.619296:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3642:x1875759226625280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863877.619462:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226625664:0@lo:8:kworker.0 00000100:00100000:2.0:1788863877.619501:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863877.619525:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226626176:0@lo:8:kworker.0 00000100:00100000:2.0:1788863877.619549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.619561:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3642:x1875759226625280:12345-0@lo:400:kworker.0 Request processed in 265us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863877.619569:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788863877.619707:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788863877.619713:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226625920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.619752:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226625920:12345-0@lo:400:kworker.0 Request processed in 39us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.619758:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788863877.619771:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788863877.619777:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226625408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.619806:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226625408:12345-0@lo:400:kworker.0 Request processed in 29us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.619811:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788863877.619835:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625536 00000100:00100000:1.0:1788863877.619839:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625536 00000100:00100000:1.0:1788863877.619868:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626048 00000100:00100000:1.0:1788863877.619872:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626048 00000100:00100000:1.0:1788863877.619884:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226625664 00000100:00100000:1.0:1788863877.619887:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226625664 00000100:00100000:1.0:1788863877.619895:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626176 00000100:00100000:1.0:1788863877.619896:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626176 00000100:00100000:1.0:1788863877.619904:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863877.619910:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226625536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.619943:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226625536:12345-0@lo:400:kworker.0 Request processed in 33us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.619949:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863877.619971:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863877.619977:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226626048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.620007:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226626048:12345-0@lo:400:kworker.0 Request processed in 30us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.620013:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863877.620023:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863877.620027:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226625664:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788863877.620060:0:18569:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1788863877.620125:0:18569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a24d 00002000:00100000:1.0:1788863877.620152:0:18569:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89e67d2b6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788863877.620157:0:18569:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788863877.620161:0:18569:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788863877.620439:0:18569:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788863877.620469:0:18569:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863877.620509:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226625664:12345-0@lo:8:kworker.0 Request processed in 480us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.620515:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863877.620529:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788863877.620533:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226626176:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788863877.620550:0:18569:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1788863877.620567:0:18569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6a254 00002000:00100000:1.0:1788863877.620573:0:18569:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff89e67d2b3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788863877.620577:0:18569:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788863877.620580:0:18569:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788863877.620604:0:18569:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788863877.620623:0:18569:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863877.620653:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226626176:12345-0@lo:8:kworker.0 Request processed in 118us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.620660:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788863877.620681:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863877.620686:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863877.620688:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863877.620729:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226625408:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.620747:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226626048:0@lo:400:kworker.0 00010000:00080000:1.0:1788863877.620762:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438ddf80 x1875759226626688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863877.620774:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226626688:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.620786:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226625280:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.620798:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226625920:0@lo:400:kworker.0 00010000:00080000:1.0:1788863877.620809:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c2680 x1875759226626560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863877.620817:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226626560:0@lo:400:kworker.0 00010000:00080000:1.0:1788863877.620877:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af59f80 x1875759226625792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863877.620886:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226625792:0@lo:400:kworker.0 00010000:00080000:1.0:1788863877.620898:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c1f80 x1875759226626432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863877.620905:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226626432:0@lo:400:kworker.0 00000100:00100000:1.0:1788863877.620928:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226625536:0@lo:400:kworker.0 00010000:00080000:1.0:1788863877.620939:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af59880 x1875759226626304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863877.620946:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226626304:0@lo:400:kworker.0 00010000:00080000:1.0:1788863877.620957:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438ded80 x1875759226626816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863877.620964:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226626816:0@lo:400:kworker.0 00010000:00080000:2.0:1788863877.621609:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af5a300 x1875759226625664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788863877.621626:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788863877.621636:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788863877.621643:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788863877.621646:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788863877.621680:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788863877.621686:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226625664:0@lo:8:kworker.0 00010000:00080000:2.0:1788863877.621700:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67af58e00 x1875759226626176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788863877.621777:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788863877.621784:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788863877.621787:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788863877.621790:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788863877.621800:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788863877.621804:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226626176:0@lo:8:kworker.0 00000004:00080000:3.0:1788863877.622028:0:17086:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788863877.622328:0:17086:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 544746251179ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788863877.622336:0:17086:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788863877.624498:0:17804:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788863877.624540:0:17804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17804:1875759226627072:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788863877.624632:0:17804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863877.624672:0:17804:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6763026c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788863877.624694:0:17803:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788863877.624802:0:17803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 544748725167ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788863877.624810:0:17803:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788863877.624921:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627072 00000100:00100000:1.0:1788863877.624930:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627072 00000100:00100000:1.0:1788863877.624995:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863877.625005:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17804:x1875759226627072:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788863877.625191:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226626944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863877.625235:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863877.626621:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863877.626649:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226626944 00000100:00100000:1.0:1788863877.626658:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226626944 00000100:00100000:1.0:1788863877.629789:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863877.629811:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875759226626944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863877.629873:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863877.629986:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875759226626944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 183us (4749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.630000:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1788863877.630692:0:17087:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788863877.630724:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17087:1875759226627328:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788863877.630779:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.630810:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d503780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863877.630836:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627328 00000100:00100000:0.0:1788863877.630845:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627328 00000100:00100000:0.0:1788863877.630910:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863877.630917:0:18570:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17087:x1875759226627328:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788863877.631924:0:17040:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:2.0:1788863877.632309:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c1f80 x1875759226626944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863877.632342:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226626944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863877.634214:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226627200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863877.634863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863877.634940:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863877.634959:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627200 00000100:00100000:1.0:1788863877.634969:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627200 00000100:00100000:1.0:1788863877.635022:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863877.635188:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226627200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863877.635220:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863877.635282:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875759226627200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.635290:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788863877.635416:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5438ded80 x1875759226627200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863877.635442:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226627200:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788863877.635800:0:18570:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788863877.635811:0:18570:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788863877.635816:0:18570:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:0.0:1788863877.636433:0:18569:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788863877.636440:0:18569:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788863877.636508:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17804:x1875759226627072:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11501us (11874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863877.636517:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788863877.641411:0:17804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440c2680 x1875759226627072/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863877.641436:0:17804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17804:1875759226627072:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788863877.641456:0:17804:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788863877.642549:0:17804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17804:1875759226627456:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788863877.642628:0:17804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.642679:0:17804:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d503e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863877.642786:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627456 00000100:00100000:1.0:1788863877.642794:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627456 00000100:00100000:1.0:1788863877.642868:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788863877.642879:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17804:x1875759226627456:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788863877.642914:0:19012:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788863877.642962:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17804:x1875759226627456:12345-0@lo:5:osp-pre-1-1.0 Request processed in 85us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863877.642970:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788863877.643055:0:17804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae5180 x1875759226627456/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863877.643068:0:17804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17804:1875759226627456:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788863877.643128:0:17804:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788863877.643168:0:17804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17804:1875759226627584:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788863877.643192:0:17804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.643208:0:17804:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d503e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863877.643223:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627584 00000100:00100000:0.0:1788863877.643226:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627584 00000100:00100000:0.0:1788863877.643252:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863877.643259:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17804:x1875759226627584:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788863877.643296:0:19251:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:1.0:1788863877.646688:0:17793:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1788863877.653896:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.653911:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.653934:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.653939:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.653947:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.653968:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.653979:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.653987:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.654017:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863877.655425:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863877.655439:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.655470:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259bc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863877.655476:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.655489:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.655518:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.655528:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a25b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.655557:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.655559:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.655561:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.657723:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.657741:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.657762:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.657768:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.657776:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.657805:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.657817:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.657827:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.658343:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863877.658362:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863877.658368:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.658377:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ae00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863877.658382:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.658392:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.658412:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.658420:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a262 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.658445:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.658447:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.658449:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863877.660577:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863877.660595:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.660614:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788863877.660619:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863877.660626:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.660640:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.660658:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.660666:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.660923:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863877.663214:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863877.663230:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.663246:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863877.663252:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.663275:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.663311:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.663318:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6a269 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.663903:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.663907:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.663909:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863877.667717:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788863877.667735:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.667758:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788863877.667764:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863877.667771:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.667789:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.667802:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.667810:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.667851:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863877.667989:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863877.667997:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.668052:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fe00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863877.668111:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.668122:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.668152:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.668160:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a4bd75/0xf569beb9d4b6a270 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.668182:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.668184:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.668185:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.668940:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.668949:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.668960:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.668964:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.668970:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.668980:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.668988:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.668994:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.669019:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863877.669395:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863877.669403:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.669412:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ae00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863877.669417:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.669427:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.669441:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.669449:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a277 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.669469:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.669471:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.669473:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.671280:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.671292:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.671321:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.671325:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.671332:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.671345:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.671355:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.671363:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.671394:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863877.671542:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863877.671550:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.671559:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863877.671571:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.671582:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.671599:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.671606:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000841441f6/0xf569beb9d4b6a27e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.671627:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.671629:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.671631:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.674225:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.674240:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.674264:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.674269:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.674276:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.674292:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.674317:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.674325:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.674349:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863877.674621:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863877.674631:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.674651:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.674655:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.674665:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.674690:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.674698:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025dc16ea/0xf569beb9d4b6a285 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.674720:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.674722:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.674724:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.677450:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.677467:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.677490:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.677502:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.677510:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.677527:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.677539:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.677546:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.677638:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788863877.678189:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.678195:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.678207:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.678210:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.678215:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.678224:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.678232:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.678245:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.683201:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788863877.683234:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863877.683246:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685676:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863877.685692:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685713:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685742:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685750:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a28c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685775:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863877.685779:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685796:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863877.685800:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685895:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685907:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685914:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a293 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.685928:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.685930:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.685932:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.686776:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.686786:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.686801:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.686806:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.686813:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.686826:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.686844:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.686853:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.686867:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788863877.688481:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.688495:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.688511:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.688516:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.688521:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.688535:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.688544:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.688552:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.689735:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863877.689748:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.689760:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863877.689765:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.689776:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.689797:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.689805:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a29a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.689834:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.689853:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.689856:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.690383:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788863877.691686:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.691698:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.691715:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.691719:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.691726:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.691742:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.691752:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.691761:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.691784:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788863877.695611:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863877.695632:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695650:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863877.695656:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695670:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695698:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695706:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695734:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863877.695739:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695746:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863877.695749:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695769:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695780:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695787:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.695800:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.695802:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.695804:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.696970:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.696983:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697002:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.697008:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.697015:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697300:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697312:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697328:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697357:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863877.697472:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863877.697480:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.697488:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259aa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863877.697498:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.697508:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.697524:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.697531:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c85d94fa/0xf569beb9d4b6a2af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.697551:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.697553:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.697555:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.697854:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.697860:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697869:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.697872:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.697876:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697886:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697893:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697900:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.697923:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863877.698123:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863877.698131:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.698150:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ae00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.698154:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.698162:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.698182:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.698189:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002994947/0xf569beb9d4b6a2b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.698204:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.698206:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.698208:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.698402:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.698409:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.698423:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.698426:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.698430:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.698440:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.698448:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.698456:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.698475:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863877.698602:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863877.698608:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.698616:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259bc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863877.698620:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.698629:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.698640:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.698652:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023cadc01/0xf569beb9d4b6a2bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.698666:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.698667:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.698669:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.698698:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.700099:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.700113:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.700130:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.700135:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.700149:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.700163:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.700184:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.700193:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.700210:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863877.700552:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863877.700561:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.700569:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788863877.700575:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.700585:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.700602:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.700610:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a2c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.700625:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.700627:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.700629:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.703214:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.703231:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703254:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.703259:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.703266:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703285:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703296:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703304:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703346:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863877.703361:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863877.703367:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703375:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863877.703379:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703387:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703405:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703413:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a2cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.703430:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.703432:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.703433:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788863877.704009:0:19382:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788863877.704034:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788863877.704040:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788863877.704450:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17804:x1875759226627584:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61185us (61251us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788863877.704463:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863877.704592:0:17804:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788863877.704610:0:17804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17804:1875759226627584:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788863877.704630:0:17804:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788863877.704695:0:17804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17804:1875759226627712:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788863877.704735:0:17804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863877.704776:0:17804:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863877.704842:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627712 00000100:00100000:2.0:1788863877.704850:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627712 00000100:00100000:2.0:1788863877.704903:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863877.704913:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17804:x1875759226627712:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788863877.704968:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17804:x1875759226627712:12345-0@lo:900:osp-pre-1-1.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863877.704975:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788863877.705005:0:17804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae5180 x1875759226627712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788863893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863877.705016:0:17804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17804:1875759226627712:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788863877.705614:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.705624:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.705642:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.705647:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.705655:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.705670:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.705682:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.705700:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.705760:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788863877.706287:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.706293:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.706304:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.706307:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.706312:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.706322:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.706330:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.706337:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706393:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863877.706401:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706409:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863877.706414:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706423:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706443:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706451:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073c83f62/0xf569beb9d4b6a2d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706469:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863877.706473:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706494:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863877.706497:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706504:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706515:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.706523:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.706524:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.706526:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863877.706739:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788863877.706745:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a2d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.707043:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.707167:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.707172:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707181:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.707185:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.707189:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707200:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707208:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707215:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707233:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788863877.707543:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.707549:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707557:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.707559:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.707627:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707638:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707648:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707656:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.707677:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788863877.707790:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863877.707797:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707806:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863877.707810:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707820:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707834:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707849:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7bd2917/0xf569beb9d4b6a2e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707866:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863877.707870:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707876:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863877.707879:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707886:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707895:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707901:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faadee5b/0xf569beb9d4b6a2e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.707912:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.707913:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.707915:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.707942:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.708208:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.708214:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.708223:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.708226:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.708230:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.708240:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.708247:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.708266:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.708285:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863877.708320:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863877.708325:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.708339:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863877.708342:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.708350:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.708362:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.708370:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87269eb/0xf569beb9d4b6a2ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863877.708383:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.708385:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863877.708386:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.709967:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.709979:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.709994:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.709999:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.710004:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.710016:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.710026:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.710034:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.710385:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863877.710752:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863877.710762:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.710772:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.710778:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.710788:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.710878:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.710900:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e981d2b/0xf569beb9d4b6a2f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.710923:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.710926:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.710927:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.711824:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.711835:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.711855:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.711860:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.711865:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.711878:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.711886:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.711894:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.711924:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863877.712401:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863877.712410:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.712419:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.712424:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.712433:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.712449:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.712457:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c0732d/0xf569beb9d4b6a2fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.712474:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.712476:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.712478:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.713291:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.713301:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.713314:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.713318:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.713324:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.713336:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.713358:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.713366:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.713520:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863877.716580:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863877.716595:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.716611:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.716617:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.716629:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.716655:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.716663:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007373930a/0xf569beb9d4b6a303 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.716688:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.716690:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.716692:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863877.718425:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.718441:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.718462:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.718468:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.718474:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.718490:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.718501:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.718518:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.718578:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863877.722198:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788863877.722218:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.722242:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788863877.722248:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863877.722255:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.722272:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.722285:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863877.722293:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722381:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863877.722391:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722400:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.722406:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722432:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722454:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722462:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095831fcf/0xf569beb9d4b6a30a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722485:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863877.722490:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722497:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.722500:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722507:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722518:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.722526:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.722528:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.722535:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863877.724355:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863877.724371:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013f35383/0xf569beb9d4b6a311 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.726382:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788863877.726709:0:18570:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788863877.726722:0:18570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.726743:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788863877.726749:0:18570:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863877.726756:0:18570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.726772:0:18570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.726783:0:18570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.726790:0:18570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863877.726829:0:18570:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788863877.726918:0:18570:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1788863877.727050:0:18570:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17087:x1875759226627328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96129us (96267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863877.727062:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863877.727172:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17087:1875759226627328:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788863877.727192:0:17087:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788863877.727252:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17087:1875759226627840:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788863877.727294:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863877.727322:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d9ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863877.727346:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627840 00000100:00100000:2.0:1788863877.727354:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627840 00000100:00100000:2.0:1788863877.727404:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863877.727414:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17087:x1875759226627840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788863877.727461:0:19012:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1788863877.730784:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863877.730806:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.730823:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922c00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863877.730829:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.730842:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.730871:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.730879:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bec417e9/0xf569beb9d4b6a318 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863877.730917:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.730919:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863877.730921:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863877.739261:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17087:x1875759226627840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11837us (11955us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788863877.739279:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863877.739758:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17087:1875759226627840:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788863877.739782:0:17087:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:1.0:1788863878.123333:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226627968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863878.123438:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863878.123612:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226627968 00000100:00100000:0.0:1788863878.123623:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226627968 00000100:00100000:0.0:1788863878.123706:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863878.123719:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226627968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788863878.123761:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788863878.136658:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226627968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 12926us (13204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863878.136692:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863878.137350:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226627968:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788863878.444424:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863879.148936:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863879.148968:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226628352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863879.149838:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.149969:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628352 00000100:00100000:0.0:1788863879.149981:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628352 00000100:00100000:0.0:1788863879.150063:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863879.150074:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226628352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863879.150148:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863879.150212:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226628352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.150219:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863879.150283:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226628352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863879.150767:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226628224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863879.150813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863879.150839:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863879.150845:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226628096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863879.150868:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863879.150957:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628096 00000100:00100000:2.0:1788863879.150961:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628096 00000100:00100000:2.0:1788863879.150990:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788863879.151592:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628224 00000100:00100000:1.0:1788863879.151600:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628224 00000100:00100000:1.0:1788863879.151661:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863879.151678:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226628224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863879.151702:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788863879.151770:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226628224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863879.151777:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863879.151824:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226628224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863879.151980:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863879.152155:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226628096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863879.152185:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788863879.152227:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226628096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1230us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.152235:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788863879.152542:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226628096:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788863879.468023:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863879.916610:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863880.492307:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863880.712322:0:19737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788863881.516555:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788863881.608525:0:19790:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788863881.608855:0:19790:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788863882.440679:0:19840:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788863882.440901:0:19840:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788863882.541060:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863882.734483:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226628480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863882.734555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863882.734653:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628480 00000100:00100000:2.0:1788863882.734662:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628480 00000100:00100000:2.0:1788863882.734712:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863882.734722:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226628480:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863882.738979:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863882.739006:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226628608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863882.739105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.740339:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226628864:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740387:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.740426:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226629376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740451:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.740470:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226629888:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.740519:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788863882.740525:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226628992:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.740562:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226629504:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740581:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.740597:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226630016:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.740646:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628864 00000100:00100000:0.0:1788863882.740653:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628864 00000100:00100000:0.0:1788863882.740700:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788863882.740709:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226628864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740762:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226628864:12345-0@lo:400:kworker.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.740770:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788863882.740795:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226629376 00000100:00100000:0.0:1788863882.740799:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226629376 00000100:00100000:0.0:1788863882.740849:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628992 00000100:00100000:0.0:1788863882.740853:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628992 00000100:00100000:0.0:1788863882.740874:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863882.740880:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226629376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740913:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226629376:12345-0@lo:400:kworker.0 Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.740919:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863882.740931:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863882.740938:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226628992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.740964:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226628992:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.740969:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863882.740986:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226629888 00000100:00100000:0.0:1788863882.740989:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226629888 00000100:00100000:0.0:1788863882.741008:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226629504 00000100:00100000:0.0:1788863882.741010:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226629504 00000100:00100000:0.0:1788863882.741021:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630016 00000100:00100000:0.0:1788863882.741023:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630016 00000100:00100000:0.0:1788863882.741051:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863882.741059:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226629888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741110:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226629888:12345-0@lo:400:kworker.0 Request processed in 52us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.741116:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863882.741129:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863882.741135:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226629504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741160:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226629504:12345-0@lo:400:kworker.0 Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.741166:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863882.741186:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788863882.741191:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226630016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741218:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226630016:12345-0@lo:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.741223:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788863882.741258:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226628736:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741290:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.741318:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226629248:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.741358:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226629760:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741377:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.741395:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788863882.741401:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226629120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.741436:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226629632:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863882.741473:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628736 00000100:00100000:0.0:1788863882.741477:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628736 00000100:00100000:0.0:1788863882.741504:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788863882.741511:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3641:x1875759226628736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.741543:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3641:x1875759226628736:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.741549:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788863882.741577:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226629248 00000100:00100000:0.0:1788863882.741581:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226629248 00000100:00100000:0.0:1788863882.741603:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863882.741617:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226629248:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788863882.743518:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863882.743528:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863882.743531:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863882.743534:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863882.743550:0:18571:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788863882.743565:0:18571:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788863882.745230:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226629760 00000100:00100000:3.0:1788863882.745244:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226629760 00000100:00100000:3.0:1788863882.745303:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226629120 00000100:00100000:3.0:1788863882.745307:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226629120 00000100:00100000:3.0:1788863882.745321:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226629632 00000100:00100000:3.0:1788863882.745332:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226629632 00000100:00100000:3.0:1788863882.745358:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863882.746964:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226629248:12345-0@lo:400:kworker.0 Request processed in 5340us (5613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.746979:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863882.747029:0:17062:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788863882.747048:0:17062:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788863882.747207:0:17060:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788863882.747220:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863882.747231:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226629120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.747312:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226629120:12345-0@lo:400:kworker.0 Request processed in 84us (5889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.747320:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863882.747340:0:17060:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788863882.747345:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788863882.747352:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226629632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.747379:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226629632:12345-0@lo:400:kworker.0 Request processed in 28us (5924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.747385:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788863882.747429:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226628992:0@lo:400:kworker.0 00010000:00080000:0.0:1788863882.747445:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae5500 x1875759226629504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863882.747455:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226629504:0@lo:400:kworker.0 00010000:00080000:0.0:1788863882.748047:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae7100 x1875759226630016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863882.748058:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226630016:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.748102:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226628864:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.748113:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226629376:0@lo:400:kworker.0 00010000:00080000:0.0:1788863882.748125:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae7800 x1875759226629888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863882.748134:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226629888:0@lo:400:kworker.0 00010000:00080000:0.0:1788863882.748183:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae6a00 x1875759226629120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863882.748193:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226629120:0@lo:400:kworker.0 00010000:00080000:0.0:1788863882.748204:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae4a80 x1875759226629632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863882.748212:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226629632:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.748222:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226628736:0@lo:400:kworker.0 00000100:00100000:0.0:1788863882.748232:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226629248:0@lo:400:kworker.0 00000100:00100000:3.0:1788863882.754799:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226629760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863882.754909:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226629760:12345-0@lo:400:kworker.0 Request processed in 9542us (13529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863882.754920:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788863882.754973:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863882.754979:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788863882.755025:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae5c00 x1875759226629760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863882.755052:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226629760:0@lo:400:kworker.0 00002000:00000024:2.0:1788863882.768384:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863882.769128:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226628480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34401us (34566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863882.769140:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863882.769213:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226628480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863882.769256:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226628608 00000100:00100000:2.0:1788863882.769264:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226628608 00000100:00080000:2.0:1788863882.769294:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863882.769322:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863882.769331:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226628608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863882.769346:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863882.770768:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226628608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1433us (31659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863882.770779:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863882.771019:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226628608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863882.910830:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863882.910950:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205568512 00000100:00100000:0.0:1788863882.910971:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205568512 00000100:00100000:0.0:1788863882.911028:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:0.0:1788863882.911046:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2407:x1875759205568512:12345-192.168.204.35@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788863882.911115:0:17053:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 08218cea-68b5-4da7-b49c-21e1cc78e39d@192.168.204.35@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1788863882.911147:0:17053:0:(genops.c:1384:class_connect()) connect: client 08218cea-68b5-4da7-b49c-21e1cc78e39d, cookie 0xf569beb9d4b6a31f 00000100:00080000:0.0:1788863882.911301:0:17053:0:(import.c:65:import_set_state_nolock()) ffff89e679e3c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863882.911614:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+5:2407:x1875759205568512:12345-192.168.204.35@tcp:250:mount.lustre.0 Request processed in 576us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.911637:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:0.0:1788863882.923530:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863882.923703:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205568640 00000100:00100000:2.0:1788863882.923713:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205568640 00000100:00100000:2.0:1788863882.923768:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:2.0:1788863882.923779:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+5:14879:x1875759205568640:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788863882.923795:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863882.923812:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650923000/0xf569beb9d4b6a326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188270 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863882.923842:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650923000/0xf569beb9d4b6a326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188270 expref: 6 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863882.923853:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650923000/0xf569beb9d4b6a326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188270 expref: 6 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863882.923862:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650923000, rc 0) 00000100:00100000:2.0:1788863882.924227:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+6:14879:x1875759205568640:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 449us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863882.924236:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:3.0:1788863882.926890:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863882.927735:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205568768 00000100:00100000:2.0:1788863882.927749:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205568768 00000100:00100000:2.0:1788863882.927814:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:2.0:1788863882.927824:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+6:14879:x1875759205568768:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788863882.927980:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+6:14879:x1875759205568768:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 157us (1099us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863882.927989:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:1.0:1788863882.943300:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863882.943419:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205568896 00000100:00100000:0.0:1788863882.943430:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205568896 00000100:00100000:0.0:1788863882.943490:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:0.0:1788863882.943500:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+6:14879:x1875759205568896:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788863882.943517:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863882.943536:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64259b800/0xf569beb9d4b6a32d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188277 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863882.943565:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259b800/0xf569beb9d4b6a32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188277 expref: 7 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863882.943576:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64259b800/0xf569beb9d4b6a32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188277 expref: 7 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863882.943584:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b800, rc 0) 00000100:00100000:0.0:1788863882.943652:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+7:14879:x1875759205568896:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 153us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.943659:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:3.0:1788863882.960227:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863882.960390:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569024 00000100:00100000:0.0:1788863882.960467:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569024 00000100:00100000:0.0:1788863882.960614:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:0.0:1788863882.960625:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+7:14879:x1875759205569024:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788863882.960808:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14879:x1875759205569024:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 183us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.960836:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:3.0:1788863882.970056:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863882.970210:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569152 00000100:00100000:2.0:1788863882.970230:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569152 00000100:00100000:2.0:1788863882.970319:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:2.0:1788863882.970330:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14879:x1875759205569152:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788863882.970647:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14879:x1875759205569152:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 317us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863882.970656:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:1.0:1788863882.989187:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863882.989613:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569280 00000100:00100000:0.0:1788863882.989624:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569280 00000100:00100000:0.0:1788863882.989684:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:0.0:1788863882.989693:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14897:x1875759205569280:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863882.989856:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14897:x1875759205569280:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 163us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863882.989863:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:3.0:1788863883.032624:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.032737:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569408 00000100:00100000:0.0:1788863883.032751:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569408 00000100:00100000:0.0:1788863883.032826:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:0.0:1788863883.032838:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14897:x1875759205569408:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863883.033047:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14897:x1875759205569408:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 209us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863883.033055:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:3.0:1788863883.040768:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863883.041618:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569536 00000100:00100000:2.0:1788863883.041633:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569536 00000100:00100000:2.0:1788863883.041713:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:2.0:1788863883.041723:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14897:x1875759205569536:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788863883.041958:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14897:x1875759205569536:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 235us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863883.041967:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:3.0:1788863883.058121:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863883.058173:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569664 00000100:00100000:3.0:1788863883.058183:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569664 00000100:00100000:3.0:1788863883.058234:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:3.0:1788863883.058243:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:14879:x1875759205569664:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788863883.058260:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863883.058278:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99c00/0xf569beb9d4b6a334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d251882a8 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863883.058319:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99c00/0xf569beb9d4b6a334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882a8 expref: 9 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863883.058343:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99c00/0xf569beb9d4b6a334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882a8 expref: 9 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863883.058353:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99c00, rc 0) 00000100:00100000:3.0:1788863883.058407:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+9:14879:x1875759205569664:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 164us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.058413:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:3.0:1788863883.084383:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.088371:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569792 00000100:00100000:0.0:1788863883.088388:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569792 00000100:00100000:0.0:1788863883.088465:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:0.0:1788863883.088477:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+9:14879:x1875759205569792:12345-192.168.204.35@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788863883.088504:0:17053:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788863883.088531:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788863883.088536:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788863883.088539:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788863883.088543:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788863883.088544:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788863883.092820:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+9:14879:x1875759205569792:12345-192.168.204.35@tcp:256:mount.lustre.0 Request processed in 4333us (8436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863883.092836:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:1.0:1788863883.103184:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863883.103462:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205569920 00000100:00100000:3.0:1788863883.103472:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205569920 00000100:00100000:3.0:1788863883.103535:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 129 00000100:00100000:3.0:1788863883.103545:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+9:14879:x1875759205569920:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788863883.103563:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863883.103581:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d251882af expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863883.103609:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 10 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863883.103620:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 10 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863883.103628:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98c00, rc 0) 00000100:00100000:3.0:1788863883.103693:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14879:x1875759205569920:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 149us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.103700:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 129 00000100:00100000:3.0:1788863883.114523:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.114893:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570048 00000100:00100000:0.0:1788863883.114905:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570048 00000100:00100000:0.0:1788863883.114972:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:0.0:1788863883.114982:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14879:x1875759205570048:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788863883.115192:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14879:x1875759205570048:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 210us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863883.115200:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:0.0:1788863883.124176:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863883.134129:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570176 00000100:00100000:2.0:1788863883.134148:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570176 00000100:00100000:2.0:1788863883.134216:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:2.0:1788863883.134226:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14879:x1875759205570176:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788863883.134406:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14879:x1875759205570176:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 181us (10239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863883.134414:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:1.0:1788863883.146838:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863883.147678:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570304 00000100:00100000:3.0:1788863883.147689:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570304 00000100:00100000:3.0:1788863883.147750:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00100000:3.0:1788863883.147761:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14901:x1875759205570304:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788863883.147932:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14901:x1875759205570304:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 172us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.147942:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00100000:3.0:1788863883.157361:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.157560:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570432 00000100:00100000:0.0:1788863883.157571:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570432 00000100:00100000:0.0:1788863883.157634:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:0.0:1788863883.157644:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14901:x1875759205570432:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863883.157805:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:14901:x1875759205570432:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 162us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863883.157813:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:0.0:1788863883.175529:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.175628:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863883.176109:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570560 00000100:00100000:3.0:1788863883.176120:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570560 00000100:00100000:3.0:1788863883.176150:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570816 00000100:00100000:3.0:1788863883.176153:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570816 00000100:00100000:3.0:1788863883.176174:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:3.0:1788863883.176182:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2407:x1875759205570560:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788863883.176213:0:17062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f2472872-203b-4543-b84a-9e24d2c107a6@192.168.204.35@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1788863883.176264:0:17062:0:(genops.c:1384:class_connect()) connect: client f2472872-203b-4543-b84a-9e24d2c107a6, cookie 0xf569beb9d4b6a342 00000004:00100000:3.0:1788863883.176286:0:17062:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788863883.176504:0:17062:0:(import.c:65:import_set_state_nolock()) ffff89e5448e4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863883.176570:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:2407:x1875759205570560:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 387us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.176578:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:3.0:1788863883.176597:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:3.0:1788863883.176601:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2407:x1875759205570816:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788863883.176616:0:17062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from f2472872-203b-4543-b84a-9e24d2c107a6@192.168.204.35@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1788863883.176644:0:17062:0:(genops.c:1384:class_connect()) connect: client f2472872-203b-4543-b84a-9e24d2c107a6, cookie 0xf569beb9d4b6a349 00000004:00100000:3.0:1788863883.176671:0:17062:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788863883.176821:0:17062:0:(import.c:65:import_set_state_nolock()) ffff89e5448e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863883.176848:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:2407:x1875759205570816:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 244us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.176855:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1788863883.208514:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863883.208555:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863883.208593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863883.208678:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571072 00000100:00100000:3.0:1788863883.208690:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571072 00000100:00100000:3.0:1788863883.208754:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570944 00000100:00100000:3.0:1788863883.208758:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570944 00000100:00100000:3.0:1788863883.208773:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205570688 00000100:00100000:3.0:1788863883.208776:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205570688 00000100:00100000:3.0:1788863883.208789:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:3.0:1788863883.208799:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+7:14879:x1875759205571072:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788863883.208838:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788863883.208919:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+7:14879:x1875759205571072:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 120us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.208938:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:3.0:1788863883.208954:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:3.0:1788863883.208961:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:0:x1875759205570944:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788863883.209002:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788863883.209109:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:0:x1875759205570944:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 147us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.209117:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:3.0:1788863883.209130:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788863883.209137:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:0:x1875759205570688:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788863883.209148:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788863883.209179:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:0:x1875759205570688:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 42us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.209185:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00080000:1.0:1788863883.209880:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863883.209886:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863883.223200:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.226718:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571200 00000100:00100000:0.0:1788863883.226734:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571200 00000100:00100000:0.0:1788863883.226822:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:0.0:1788863883.226833:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:14879:x1875759205571200:12345-192.168.204.35@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788863883.226947:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:14879:x1875759205571200:12345-192.168.204.35@tcp:40:mount.lustre.0 Request processed in 116us (3760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863883.226973:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:0.0:1788863883.232647:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.232726:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.232774:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863883.232959:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571328 00000100:00100000:1.0:1788863883.232973:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571328 00000100:00100000:1.0:1788863883.233023:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571456 00000100:00100000:1.0:1788863883.233036:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571456 00000100:00100000:1.0:1788863883.233108:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1788863883.233120:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2407:x1875759205571328:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788863883.233168:0:19012:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f2472872-203b-4543-b84a-9e24d2c107a6@192.168.204.35@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1788863883.233215:0:19012:0:(genops.c:1384:class_connect()) connect: client f2472872-203b-4543-b84a-9e24d2c107a6, cookie 0xf569beb9d4b6a350 00002000:00100000:1.0:1788863883.233229:0:19012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f2472872-203b-4543-b84a-9e24d2c107a6/ffff89e67d2b0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788863883.233273:0:19012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788863883.233693:0:19012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788863883.233801:0:19012:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863883.233898:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+6:2407:x1875759205571328:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 779us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863883.233908:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1788863883.233934:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:1.0:1788863883.233940:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2407:x1875759205571456:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788863883.233964:0:19012:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f2472872-203b-4543-b84a-9e24d2c107a6@192.168.204.35@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1788863883.233987:0:19012:0:(genops.c:1384:class_connect()) connect: client f2472872-203b-4543-b84a-9e24d2c107a6, cookie 0xf569beb9d4b6a357 00002000:00100000:1.0:1788863883.233994:0:19012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f2472872-203b-4543-b84a-9e24d2c107a6/ffff89e67d2b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788863883.234003:0:19012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00100000:2.0:1788863883.234823:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571584 00000100:00100000:2.0:1788863883.234833:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571584 00000100:00100000:2.0:1788863883.234893:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:2.0:1788863883.234903:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2472872-203b-4543-b84a-9e24d2c107a6+6:14879:x1875759205571584:12345-192.168.204.35@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788863883.234976:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2472872-203b-4543-b84a-9e24d2c107a6+6:14879:x1875759205571584:12345-192.168.204.35@tcp:900:mount.lustre.0 Request processed in 74us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863883.234984:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00002000:00080000:1.0:1788863883.236334:0:19012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788863883.236386:0:19012:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863883.236466:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+6:2407:x1875759205571456:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 2523us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863883.236476:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1788863883.243967:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863883.244001:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226630144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863883.244464:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863883.245490:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630144 00000100:00100000:3.0:1788863883.245503:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630144 00000100:00100000:3.0:1788863883.245575:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863883.245588:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226630144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863883.245634:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788863883.246699:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226630144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1107us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863883.246722:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863883.247010:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863883.250525:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571712 00000100:00100000:2.0:1788863883.250549:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571712 00000100:00100000:2.0:1788863883.250661:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:2.0:1788863883.250684:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+6:14879:x1875759205571712:12345-192.168.204.35@tcp:33:mount.lustre.0 00000001:00100000:0.0:1788863883.253159:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000001:00080000:0.0:1788863883.253183:0:19382:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000004:00080000:3.0:1788863883.255951:0:17063:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5129us 00000100:00100000:1.0:1788863883.260354:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226630144:0@lo:13:osp-pre-0-1.0 00000004:00200000:1.0:1788863883.308725:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788863883.308928:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+6:14879:x1875759205571712:12345-192.168.204.35@tcp:33:mount.lustre.0 Request processed in 58249us (61913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863883.308948:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00010000:00010000:3.0:1788863883.563838:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863883.710066:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863883.710835:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571840 00000100:00100000:0.0:1788863883.710851:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571840 00000100:00100000:0.0:1788863883.711397:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1788863883.711413:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+6:14924:x1875759205571840:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:0.0:1788863883.711443:0:19853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863883.711479:0:19853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a35e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251882e0 expref: -99 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863883.711574:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a365 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863883.711598:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863883.711616:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863883.711686:0:19853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788863883.711692:0:19853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863883.713372:0:19853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863883.713551:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a35e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882e0 expref: 8 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863883.713580:0:19853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882e0 expref: 7 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863883.713591:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:0.0:1788863883.713594:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863883.713598:0:19853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a600, rc 0) 00000100:00100000:0.0:1788863883.714834:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+7:14924:x1875759205571840:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 2297us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863883.714857:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1788863884.267515:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863884.267546:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226630400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863884.267546:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226630272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863884.267654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863884.267706:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863884.267714:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226630528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863884.267749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863884.267801:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630400 00000100:00100000:3.0:1788863884.267811:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630400 00000100:00100000:0.0:1788863884.267836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863884.267877:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630272 00000100:00100000:0.0:1788863884.267882:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630272 00000100:00100000:3.0:1788863884.267886:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863884.267899:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226630400:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863884.267910:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863884.267920:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226630272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863884.267948:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788863884.268028:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226630400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863884.268048:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00000024:0.0:1788863884.268060:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863884.268130:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226630272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 211us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863884.268138:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226630400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863884.268139:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863884.268259:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226630272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863884.268618:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630528 00000100:00100000:2.0:1788863884.268624:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630528 00000100:00100000:2.0:1788863884.268692:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863884.268701:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226630528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863884.268718:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788863884.268763:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226630528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863884.268781:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863884.269279:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226630528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863884.269602:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863884.587519:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863885.613564:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863885.868803:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788863886.289170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.289402:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205571968 00000100:00100000:0.0:1788863886.289416:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205571968 00000100:00100000:0.0:1788863886.289523:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:0.0:1788863886.289536:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+7:14977:x1875759205571968:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:0.0:1788863886.289591:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788863886.289725:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+7:14977:x1875759205571968:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 191us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.289734:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00080000:1.0:1788863886.291031:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863886.304541:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.304753:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572096 00000100:00100000:2.0:1788863886.304768:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572096 00000100:00080000:1.0:1788863886.304987:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863886.305903:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1788863886.305925:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+6:14977:x1875759205572096:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788863886.305994:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788863886.306144:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+6:14977:x1875759205572096:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 227us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.306153:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:3.0:1788863886.311243:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863886.311679:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572224 00000100:00100000:1.0:1788863886.311695:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572224 00000100:00100000:1.0:1788863886.311796:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:1.0:1788863886.311807:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2472872-203b-4543-b84a-9e24d2c107a6+6:14977:x1875759205572224:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1788863886.311863:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788863886.312009:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2472872-203b-4543-b84a-9e24d2c107a6+6:14977:x1875759205572224:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 202us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863886.312018:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00080000:3.0:1788863886.313121:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863886.317772:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.318034:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572352 00000100:00100000:2.0:1788863886.318049:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572352 00000100:00100000:2.0:1788863886.318375:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1788863886.318389:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2472872-203b-4543-b84a-9e24d2c107a6+5:14977:x1875759205572352:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788863886.318436:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863886.318587:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2472872-203b-4543-b84a-9e24d2c107a6+5:14977:x1875759205572352:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 201us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.318596:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00080000:3.0:1788863886.318665:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863886.577114:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.577339:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572480 00000100:00100000:2.0:1788863886.577354:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572480 00000100:00100000:2.0:1788863886.577429:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:2.0:1788863886.577442:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:15008:x1875759205572480:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788863886.577466:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863886.577489:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650922800/0xf569beb9d4b6a36c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d251882e7 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863886.577528:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650922800/0xf569beb9d4b6a36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882e7 expref: 11 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863886.577563:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650922800/0xf569beb9d4b6a36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882e7 expref: 11 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863886.577574:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922800, rc 0) 00000100:00100000:2.0:1788863886.577669:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15008:x1875759205572480:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 230us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.577676:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:0.0:1788863886.594912:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863886.596298:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572608 00000100:00100000:3.0:1788863886.596318:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572608 00000100:00100000:3.0:1788863886.596420:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:3.0:1788863886.596432:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15008:x1875759205572608:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788863886.596667:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15008:x1875759205572608:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 236us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863886.596676:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:3.0:1788863886.604539:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.604721:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572736 00000100:00100000:0.0:1788863886.604735:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572736 00000100:00100000:0.0:1788863886.604810:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:0.0:1788863886.604822:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15008:x1875759205572736:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788863886.605066:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15008:x1875759205572736:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 245us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.605122:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:1.0:1788863886.633479:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.634796:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572864 00000100:00100000:2.0:1788863886.634814:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572864 00000100:00100000:2.0:1788863886.634908:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:2.0:1788863886.634921:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15016:x1875759205572864:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788863886.635253:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15016:x1875759205572864:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 333us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.635263:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 137 00010000:00010000:1.0:1788863886.636394:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863886.662626:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863886.662735:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205572992 00000100:00100000:3.0:1788863886.662750:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205572992 00000100:00100000:3.0:1788863886.662833:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:3.0:1788863886.662846:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15016:x1875759205572992:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788863886.663164:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15016:x1875759205572992:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 320us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863886.663174:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:3.0:1788863886.665997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.666339:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205573120 00000100:00100000:0.0:1788863886.666352:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205573120 00000100:00100000:0.0:1788863886.666429:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:0.0:1788863886.666442:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15016:x1875759205573120:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863886.666674:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15016:x1875759205573120:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 233us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.666684:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:1.0:1788863886.669886:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.670015:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205573248 00000100:00100000:2.0:1788863886.670029:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205573248 00000100:00100000:2.0:1788863886.670135:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:2.0:1788863886.670148:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:15008:x1875759205573248:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788863886.670173:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863886.670197:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650922e00/0xf569beb9d4b6a373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188318 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863886.670236:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650922e00/0xf569beb9d4b6a373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188318 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863886.670250:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650922e00/0xf569beb9d4b6a373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188318 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863886.670278:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922e00, rc 0) 00000100:00100000:2.0:1788863886.670357:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:15008:x1875759205573248:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 212us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.670366:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:1.0:1788863886.676352:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863886.676551:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205573376 00000100:00100000:3.0:1788863886.676565:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205573376 00000100:00100000:3.0:1788863886.676639:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:3.0:1788863886.676652:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:15008:x1875759205573376:12345-192.168.204.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788863886.676688:0:17054:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788863886.676722:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788863886.676727:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788863886.676730:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788863886.676732:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788863886.676735:0:17054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788863886.682566:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:15008:x1875759205573376:12345-192.168.204.35@tcp:256:mount.lustre.0 Request processed in 5899us (6212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.682586:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:1.0:1788863886.686506:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.686917:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205573504 00000100:00100000:0.0:1788863886.686931:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205573504 00000100:00100000:0.0:1788863886.687071:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:0.0:1788863886.687360:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:15008:x1875759205573504:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788863886.687483:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863886.687509:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518831f expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863886.687545:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863886.687557:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863886.687568:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259bc00, rc 0) 00000100:00100000:0.0:1788863886.687807:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15008:x1875759205573504:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 450us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.687814:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:1.0:1788863886.691567:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.691791:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205573632 00000100:00100000:2.0:1788863886.691806:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205573632 00000100:00100000:2.0:1788863886.692360:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 143 00000100:00100000:2.0:1788863886.692378:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15008:x1875759205573632:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788863886.692611:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15008:x1875759205573632:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 240us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.692621:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 143 00000100:00100000:3.0:1788863886.694777:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.695290:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205573760 00000100:00100000:0.0:1788863886.695305:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205573760 00000100:00100000:0.0:1788863886.695381:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 144 00000100:00100000:0.0:1788863886.695392:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15008:x1875759205573760:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788863886.695670:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15008:x1875759205573760:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 278us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.695678:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 144 00000100:00100000:1.0:1788863886.699886:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863886.700197:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205573888 00000100:00100000:3.0:1788863886.700211:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205573888 00000100:00100000:3.0:1788863886.700286:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:3.0:1788863886.700299:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15019:x1875759205573888:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788863886.700522:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15019:x1875759205573888:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 224us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863886.700531:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:1.0:1788863886.719442:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.719723:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574016 00000100:00100000:2.0:1788863886.719741:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574016 00000100:00100000:2.0:1788863886.719835:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:2.0:1788863886.720005:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15019:x1875759205574016:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788863886.720283:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:15019:x1875759205574016:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 436us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.720291:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 146 00000100:00100000:1.0:1788863886.731924:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.732156:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574144 00000100:00100000:0.0:1788863886.732172:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574144 00000100:00100000:0.0:1788863886.732238:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:0.0:1788863886.732249:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2407:x1875759205574144:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788863886.732293:0:17062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d@192.168.204.35@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1788863886.732367:0:17062:0:(genops.c:1384:class_connect()) connect: client 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d, cookie 0xf569beb9d4b6a381 00000004:00100000:0.0:1788863886.732473:0:17062:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788863886.732622:0:17062:0:(import.c:65:import_set_state_nolock()) ffff89e68084e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863886.732723:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2407:x1875759205574144:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 473us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.732731:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:1.0:1788863886.734066:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.734595:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574400 00000100:00100000:0.0:1788863886.734607:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574400 00000100:00100000:0.0:1788863886.734667:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:0.0:1788863886.734677:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2407:x1875759205574400:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788863886.734721:0:19853:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d@192.168.204.35@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1788863886.734798:0:19853:0:(genops.c:1384:class_connect()) connect: client 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d, cookie 0xf569beb9d4b6a388 00000004:00100000:0.0:1788863886.734833:0:19853:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788863886.734980:0:19853:0:(import.c:65:import_set_state_nolock()) ffff89e68084d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863886.735210:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2407:x1875759205574400:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 532us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.735220:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1788863886.741788:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.741935:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574656 00000100:00100000:0.0:1788863886.741950:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574656 00000100:00100000:0.0:1788863886.742059:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:0.0:1788863886.742070:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205574656:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788863886.742150:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788863886.742250:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205574656:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 182us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.742258:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00080000:3.0:1788863886.743860:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863886.748022:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863886.748096:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863886.748135:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.749053:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574528 00000100:00100000:2.0:1788863886.749070:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574528 00000100:00100000:2.0:1788863886.749212:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574272 00000100:00100000:2.0:1788863886.749236:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574272 00000100:00100000:2.0:1788863886.749259:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574784 00000100:00100000:2.0:1788863886.749262:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574784 00000100:00100000:2.0:1788863886.749283:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:2.0:1788863886.749296:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:0:x1875759205574528:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788863886.749344:0:17060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788863886.749771:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:0:x1875759205574528:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 476us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.749781:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:2.0:1788863886.749807:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788863886.749814:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+7:0:x1875759205574272:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788863886.749830:0:17060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788863886.749951:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+7:0:x1875759205574272:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 137us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.749967:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:0.0:1788863886.750112:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:0.0:1788863886.750125:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205574784:12345-192.168.204.35@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788863886.750172:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205574784:12345-192.168.204.35@tcp:40:mount.lustre.0 Request processed in 51us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.750178:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00080000:1.0:1788863886.750974:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863886.773629:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.773753:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863886.777867:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.777930:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205574912 00000100:00100000:0.0:1788863886.777944:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205574912 00000100:00100000:1.0:1788863886.778170:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575168 00000100:00100000:1.0:1788863886.778214:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575168 00000100:00100000:2.0:1788863886.778298:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:2.0:1788863886.778311:0:17071:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205575168:12345-192.168.204.35@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788863886.778429:0:17071:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205575168:12345-192.168.204.35@tcp:900:mount.lustre.0 Request processed in 120us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.778438:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:0.0:1788863886.779162:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575040 00000100:00100000:0.0:1788863886.779172:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575040 00000100:00100000:2.0:1788863886.779318:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1788863886.779326:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2407:x1875759205574912:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788863886.779378:0:19251:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d@192.168.204.35@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1788863886.779429:0:19251:0:(genops.c:1384:class_connect()) connect: client 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d, cookie 0xf569beb9d4b6a38f 00002000:00100000:2.0:1788863886.779443:0:19251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d/ffff89e5425be800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788863886.779457:0:19251:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788863886.779590:0:19251:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788863886.779637:0:19251:0:(import.c:65:import_set_state_nolock()) ffff89e543ac6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863886.779702:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2407:x1875759205574912:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 374us (6087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.779710:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1788863886.779731:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:2.0:1788863886.779735:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2407:x1875759205575040:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788863886.779753:0:19251:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d@192.168.204.35@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1788863886.779775:0:19251:0:(genops.c:1384:class_connect()) connect: client 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d, cookie 0xf569beb9d4b6a396 00002000:00100000:2.0:1788863886.779780:0:19251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d/ffff89e543ac6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788863886.779786:0:19251:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788863886.779839:0:19251:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788863886.779856:0:19251:0:(import.c:65:import_set_state_nolock()) ffff89e543ac5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863886.779881:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2407:x1875759205575040:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 143us (6128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863886.779888:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:1.0:1788863886.782338:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863886.782434:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575296 00000100:00100000:0.0:1788863886.782447:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575296 00000100:00100000:0.0:1788863886.782543:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1788863886.782556:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205575296:12345-192.168.204.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788863886.782693:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788863886.782801:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15008:x1875759205575296:12345-192.168.204.35@tcp:33:mount.lustre.0 Request processed in 248us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863886.782810:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1788863887.013677:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863887.014229:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575424 00000100:00100000:2.0:1788863887.014243:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575424 00000100:00100000:2.0:1788863887.014324:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1788863887.014336:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15042:x1875759205575424:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:2.0:1788863887.014384:0:19853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863887.014419:0:19853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a39d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188350 expref: -99 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863887.014510:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863887.014528:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863887.014546:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863887.014608:0:19853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788863887.014613:0:19853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863887.014639:0:19853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863887.014671:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 8 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863887.014695:0:19853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 7 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863887.014704:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:2.0:1788863887.014707:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863887.014711:0:19853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922c00, rc 0) 00000100:00100000:2.0:1788863887.014977:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+7:15042:x1875759205575424:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 642us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863887.014999:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00010000:00010000:0.0:1788863887.661056:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863887.852369:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863887.852404:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226630656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863887.852474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863887.852914:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630656 00000100:00100000:3.0:1788863887.852923:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630656 00000100:00100000:3.0:1788863887.852997:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863887.853007:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226630656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863887.853031:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788863887.853109:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226630656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863887.853137:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863887.853180:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788863887.853201:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226630656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863887.853352:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226630912:0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853398:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863887.853430:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226631424:0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863887.853466:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226631936:0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863887.853504:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863887.853509:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226631040:0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863887.853541:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226631552:0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863887.853574:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226632064:0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863887.853622:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630912 00000100:00100000:3.0:1788863887.853626:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630912 00000100:00100000:3.0:1788863887.853654:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863887.853661:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226630912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853700:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226630912:12345-0@lo:400:kworker.0 Request processed in 40us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863887.853706:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863887.853724:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631936 00000100:00100000:3.0:1788863887.853734:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631936 00000100:00100000:3.0:1788863887.853761:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632064 00000100:00100000:3.0:1788863887.853764:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632064 00000100:00100000:3.0:1788863887.853784:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863887.853790:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226631936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.853819:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226631936:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863887.854060:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863887.854101:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863887.854109:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226632064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.854140:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226632064:12345-0@lo:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863887.854147:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863887.854165:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631424 00000100:00100000:3.0:1788863887.854169:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631424 00000100:00100000:3.0:1788863887.854194:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631040 00000100:00100000:3.0:1788863887.854198:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631040 00000100:00100000:3.0:1788863887.854214:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631552 00000100:00100000:3.0:1788863887.854217:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631552 00000100:00100000:3.0:1788863887.854229:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788863887.854234:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226631424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.854262:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226631424:12345-0@lo:400:kworker.0 Request processed in 28us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863887.854268:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788863887.854279:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863887.854284:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226631040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.854307:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226631040:12345-0@lo:400:kworker.0 Request processed in 23us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863887.854322:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863887.854734:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863887.854743:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226631552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.854775:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226631552:12345-0@lo:400:kworker.0 Request processed in 35us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863887.854781:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788863887.855109:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226631168:0@lo:400:kworker.0 00000100:00100000:0.0:1788863887.855148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863887.855344:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863887.855349:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863887.855352:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863887.855354:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863887.855406:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631168 00000100:00100000:1.0:1788863887.855412:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631168 00000100:00100000:1.0:1788863887.855444:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788863887.855452:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226631168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.855488:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226631168:12345-0@lo:400:kworker.0 Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863887.855494:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788863887.855532:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226631040:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.855544:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226631552:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.855556:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226632064:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.855566:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226630912:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.855574:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226631424:0@lo:400:kworker.0 00010000:00080000:1.0:1788863887.855586:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54418ea00 x1875759226631936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863887.855596:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226631936:0@lo:400:kworker.0 00000100:00100000:0.0:1788863887.856032:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226631680:0@lo:400:kworker.0 00000100:00100000:0.0:1788863887.856063:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863887.856114:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226632192:0@lo:400:kworker.0 00000100:00100000:0.0:1788863887.856136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863887.856165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226631168:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.860246:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226630784:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.860355:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863887.860424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226631296:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.860454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863887.860481:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226631808:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.860505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863887.860548:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631296 00000100:00100000:1.0:1788863887.860557:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631296 00000100:00100000:1.0:1788863887.860605:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863887.860615:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226631296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.860672:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226631296:12345-0@lo:400:kworker.0 Request processed in 59us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863887.860679:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863887.860708:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631680 00000100:00100000:1.0:1788863887.860712:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631680 00000100:00100000:1.0:1788863887.860736:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632192 00000100:00100000:1.0:1788863887.860739:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632192 00000100:00100000:1.0:1788863887.860762:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226631808 00000100:00100000:1.0:1788863887.860765:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226631808 00000100:00100000:1.0:1788863887.860781:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788863887.860787:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226631680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.861163:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226631680:12345-0@lo:400:kworker.0 Request processed in 375us (5098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863887.861171:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788863887.861187:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788863887.861194:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226632192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.861226:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226632192:12345-0@lo:400:kworker.0 Request processed in 33us (5089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863887.861244:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788863887.861259:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788863887.861264:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226631808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.861292:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226631808:12345-0@lo:400:kworker.0 Request processed in 28us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863887.861297:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788863887.861321:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863887.861335:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863887.861367:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226631680:0@lo:400:kworker.0 00010000:00080000:1.0:1788863887.861381:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54418c380 x1875759226632192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863887.861505:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226632192:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.861545:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226631296:0@lo:400:kworker.0 00000100:00100000:1.0:1788863887.861555:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226631808:0@lo:400:kworker.0 00000100:00100000:0.0:1788863887.861654:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226630784 00000100:00100000:0.0:1788863887.861659:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226630784 00000100:00100000:0.0:1788863887.861700:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863887.861707:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3641:x1875759226630784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863887.861742:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3641:x1875759226630784:12345-0@lo:400:kworker.0 Request processed in 37us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863887.861748:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788863887.861960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226630784:0@lo:400:kworker.0 00000100:00100000:3.0:1788863887.862549:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863887.862562:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226632320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863887.862601:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863887.862677:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632320 00000100:00100000:0.0:1788863887.862682:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632320 00000100:00100000:0.0:1788863887.862720:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863887.862728:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226632320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863887.862744:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788863887.862780:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226632320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863887.862786:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788863887.862870:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226632320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863888.367427:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226632448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863888.367506:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863888.367993:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632448 00000100:00100000:3.0:1788863888.368003:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632448 00000100:00100000:3.0:1788863888.368058:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863888.368068:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226632448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863888.368129:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788863888.368180:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226632448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863888.368187:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788863888.368226:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226632448:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788863888.684165:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788863888.888326:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00100000:2.0:1788863888.888340:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000001:00100000:3.0:1788863888.888818:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00100000:3.0:1788863888.888840:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000001:00100000:0.0:1788863888.890790:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00100000:0.0:1788863888.890803:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000040:00080000:3.0:1788863889.134651:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788863889.389416:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863889.389442:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226632576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863889.389512:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863889.389584:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226632704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863889.389627:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863889.389663:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632704 00000100:00100000:3.0:1788863889.389671:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632704 00000100:00100000:3.0:1788863889.389728:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788863889.389746:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226632704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863889.389781:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788863889.389827:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226632704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863889.389834:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788863889.389875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226632704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863889.390286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226632832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863889.390321:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863889.390402:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632832 00000100:00100000:1.0:1788863889.390408:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632832 00000100:00100000:1.0:1788863889.390448:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788863889.390455:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226632832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863889.390485:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788863889.390521:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226632832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863889.390527:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788863889.391356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226632832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863889.391473:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632576 00000100:00100000:0.0:1788863889.391479:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632576 00000100:00100000:0.0:1788863889.391539:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863889.391547:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226632576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863889.391564:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788863889.391617:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226632576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863889.391623:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863889.391675:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226632576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788863889.391915:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788863889.710400:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863890.732408:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788863890.799464:0:19940:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788863891.756600:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863891.949982:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950042:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950067:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950112:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950129:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950158:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950171:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950191:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863891.950228:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575680 00000100:00100000:3.0:1788863891.950238:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575680 00000100:00100000:3.0:1788863891.950303:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575808 00000100:00100000:3.0:1788863891.950306:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575808 00000100:00100000:3.0:1788863891.950332:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576192 00000100:00100000:3.0:1788863891.950334:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576192 00000100:00100000:3.0:1788863891.950345:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576320 00000100:00100000:3.0:1788863891.950346:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576320 00000100:00100000:3.0:1788863891.950472:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:3.0:1788863891.950493:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:2411:x1875759205575680:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863891.950582:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:2411:x1875759205575680:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 91us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863891.950636:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575552 00000100:00100000:0.0:1788863891.950640:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575552 00000100:00100000:0.0:1788863891.950683:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 148 00000100:00100000:0.0:1788863891.950690:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2411:x1875759205575552:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863891.950724:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2411:x1875759205575552:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 35us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863891.950731:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 148 00000100:00100000:2.0:1788863891.951111:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205575936 00000100:00100000:2.0:1788863891.951115:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205575936 00000100:00100000:2.0:1788863891.951141:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576064 00000100:00100000:2.0:1788863891.951144:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576064 00000100:00100000:2.0:1788863891.951154:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576448 00000100:00100000:2.0:1788863891.951156:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576448 00000100:00100000:2.0:1788863891.951167:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576576 00000100:00100000:2.0:1788863891.951169:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576576 00000100:00100000:2.0:1788863891.951184:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:2.0:1788863891.951190:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205575936:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863891.951223:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205575936:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 33us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.951229:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:2.0:1788863891.951241:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:2.0:1788863891.951247:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205576064:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863891.951268:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205576064:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.951273:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:2.0:1788863891.951283:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1788863891.951288:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205576448:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863891.951315:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205576448:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.951321:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1788863891.951331:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:2.0:1788863891.951336:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205576576:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863891.951352:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205576576:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 17us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.951358:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00080000:2.0:1788863891.951396:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863891.951400:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863891.951402:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788863891.951404:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863891.954881:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:1.0:1788863891.954909:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205575808:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863891.955028:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205575808:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 135us (4959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.955037:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:1.0:1788863891.955071:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:1.0:1788863891.955091:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205576192:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863891.955115:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205576192:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.955121:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:1.0:1788863891.955131:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:1.0:1788863891.955138:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205576320:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863891.955156:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205576320:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 19us (4997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.955162:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:3.0:1788863891.961937:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00010000:00010000:0.0:1788863892.780682:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863892.973048:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226633216:0@lo:400:kworker.0 00000100:00100000:2.0:1788863892.973048:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226633088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863892.973199:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226632960:0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.979663:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863892.979737:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863892.979750:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226633344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863892.979811:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863892.979857:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633216 00000100:00100000:3.0:1788863892.979865:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633216 00000100:00100000:3.0:1788863892.979911:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863892.979919:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226633216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.979979:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226633216:12345-0@lo:400:kworker.0 Request processed in 60us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863892.979986:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863892.980010:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633344 00000100:00100000:3.0:1788863892.980014:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633344 00000100:00100000:3.0:1788863892.980050:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788863892.980056:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226633344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863892.980096:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788863892.980131:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226633344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863892.980137:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863892.982949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863892.983013:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226632960 00000100:00100000:0.0:1788863892.983023:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226632960 00000100:00100000:0.0:1788863892.983071:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788863892.983095:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3642:x1875759226632960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.983155:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3642:x1875759226632960:12345-0@lo:400:kworker.0 Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.983163:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788863892.983247:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226632960:0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.983476:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226633344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863892.983492:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226633216:0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.983595:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226633728:0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.983632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863892.983666:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633728 00000100:00100000:3.0:1788863892.983671:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633728 00000100:00100000:3.0:1788863892.983702:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863892.983708:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226633728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.983746:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226633728:12345-0@lo:400:kworker.0 Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863892.983752:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863892.983780:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226633728:0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.983808:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863892.983814:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226633856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.983855:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863892.983938:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226633472:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.983968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863892.983989:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226633984:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.984024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1788863892.987917:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000100:00100000:1.0:1788863892.989805:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226634240:0@lo:400:kworker.0 00000100:00100000:2.0:1788863892.989912:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863892.989922:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863892.989999:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863892.990009:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226634368:0@lo:400:kworker.0 00000100:00100000:1.0:1788863892.990036:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863892.990066:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788863892.990131:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633088 00000100:00100000:0.0:1788863892.990140:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633088 00000100:00100000:1.0:1788863892.990182:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226634496:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.990207:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863892.990223:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226633088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863892.990236:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788863892.990249:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863892.990276:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226633600:0@lo:400:kworker.0 00000100:00100000:1.0:1788863892.990330:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863892.990346:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226633088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863892.990357:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226634112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.990359:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788863892.990397:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863892.990419:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226634240 00000100:00100000:0.0:1788863892.990426:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226634240 00000100:00100000:0.0:1788863892.990452:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226634368 00000100:00100000:0.0:1788863892.990455:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226634368 00000100:00100000:0.0:1788863892.990470:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226634496 00000100:00100000:0.0:1788863892.990473:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226634496 00000100:00100000:0.0:1788863892.990484:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226634112 00000100:00100000:0.0:1788863892.990486:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226634112 00000100:00100000:0.0:1788863892.990499:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863892.990505:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226634240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.990559:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226634240:12345-0@lo:400:kworker.0 Request processed in 53us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.990565:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863892.990577:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863892.990583:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226634368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.990611:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226634368:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.990616:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863892.990643:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788863892.990648:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226634496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.990685:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226634496:12345-0@lo:400:kworker.0 Request processed in 37us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.990691:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788863892.990702:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788863892.990708:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226634112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.990734:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226634112:12345-0@lo:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.990740:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788863892.990791:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226634496:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.990802:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226634112:0@lo:400:kworker.0 00010000:00080000:1.0:1788863892.992152:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5428a9c00 x1875759226634368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863892.992174:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226634368:0@lo:400:kworker.0 00000100:00100000:1.0:1788863892.992191:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226634240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.992929:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633472 00000100:00100000:0.0:1788863892.992943:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633472 00000100:00100000:0.0:1788863892.993010:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633984 00000100:00100000:0.0:1788863892.993014:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633984 00000100:00100000:0.0:1788863892.993038:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633600 00000100:00100000:0.0:1788863892.993040:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633600 00000100:00100000:0.0:1788863892.993056:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863892.993065:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226633472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.993230:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226633472:12345-0@lo:400:kworker.0 Request processed in 166us (9261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.993237:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863892.993252:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863892.993257:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.993284:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226633984:12345-0@lo:400:kworker.0 Request processed in 28us (9260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.993299:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863892.993309:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863892.993314:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226633600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.993371:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226633600:12345-0@lo:400:kworker.0 Request processed in 56us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.993574:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863892.993602:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226633856 00000100:00100000:0.0:1788863892.993606:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226633856 00000100:00100000:0.0:1788863892.993637:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863892.993643:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226633856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.993681:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226633856:12345-0@lo:400:kworker.0 Request processed in 39us (9827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863892.993687:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788863892.993702:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863892.993707:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863892.993711:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863892.993771:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226633856:0@lo:400:kworker.0 00000100:00080000:0.0:1788863892.993784:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863892.993994:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226633600:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.994007:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226633472:0@lo:400:kworker.0 00000100:00100000:0.0:1788863892.994017:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226633984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863892.994892:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863892.994921:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226634624:0@lo:400:kworker.0 00000100:00100000:1.0:1788863892.995011:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863892.995432:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226634624 00000100:00100000:3.0:1788863892.995442:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226634624 00000100:00100000:3.0:1788863892.995500:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863892.995508:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226634624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863892.995579:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226634624:12345-0@lo:400:kworker.0 Request processed in 71us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863892.995586:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788863892.995632:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5428a8a80 x1875759226634624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863892.996115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226634624:0@lo:400:kworker.0 00000100:00080000:1.0:1788863892.996168:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863892.996238:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226633088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863893.485861:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226634752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863893.485940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863893.488489:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226634752 00000100:00100000:2.0:1788863893.488513:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226634752 00000100:00100000:2.0:1788863893.488608:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788863893.488621:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226634752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863893.488666:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788863893.493683:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226634752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5046us (7724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863893.493706:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863893.494569:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226634752:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788863893.804908:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863894.507488:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226634880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863894.507567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863894.507624:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226634880 00000100:00100000:0.0:1788863894.507631:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226634880 00000100:00100000:0.0:1788863894.507686:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863894.507694:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226634880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863894.507726:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863894.507824:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226634880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863894.507832:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788863894.507874:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226634880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863894.507988:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863894.507998:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226635008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863894.508029:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863894.508064:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226635008 00000100:00100000:1.0:1788863894.508068:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226635008 00000100:00100000:1.0:1788863894.508130:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788863894.508137:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226635008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863894.508150:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788863894.508180:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226635008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.508187:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788863894.508203:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863894.508226:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226635008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863894.511209:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226635136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863894.511281:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863894.511347:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226635136 00000100:00100000:3.0:1788863894.511356:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226635136 00000100:00100000:3.0:1788863894.511415:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788863894.511425:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226635136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863894.511455:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788863894.511509:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226635136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863894.511516:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788863894.511542:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226635136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788863894.832609:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788863895.083836:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788863895.094347:0:20087:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0b5f3130 20000000:00000080:0.0:1788863895.094365:0:20087:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e68088ec00 uarg=0000000000000000 20000000:01000000:0.0:1788863895.094419:0:20087:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788863895.094425:0:20087:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788863895.094430:0:20087:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788863895.094982:0:20088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788863895.095311:0:20087:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788863895.106337:0:20087:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788863895.106373:0:20087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106461:0:20087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 23 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106470:0:20087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106477:0:20087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106484:0:20087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106510:0:20087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 12 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106517:0:20087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106526:0:20087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106572:0:20087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106588:0:20087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 12 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.106605:0:20087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635264:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863895.106888:0:20087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 12 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106897:0:20087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 12 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.106907:0:20087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635392:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863895.106943:0:20087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.106952:0:20087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 23 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.106973:0:20087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635520:0@lo:104: 00000100:00100000:0.0:1788863895.107015:0:20087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863895.107574:0:20087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.107583:0:20087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 23 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.107592:0:20087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635648:0@lo:104: 00000100:00100000:0.0:1788863895.107620:0:20087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863895.108438:0:20087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.108447:0:20087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 23 pid: 17055 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.108457:0:20087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635776:0@lo:104: 00000100:00100000:0.0:1788863895.108504:0:20087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863895.108784:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226635520 00000100:00100000:1.0:1788863895.108804:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226635520 00000100:00100000:3.0:1788863895.108856:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226635648 00000100:00100000:3.0:1788863895.108860:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226635648 00000100:00100000:3.0:1788863895.108883:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863895.108892:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:20087:x1875759226635520:12345-0@lo:104: 00010000:00010000:3.0:1788863895.108904:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.108966:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863895.108973:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:20087:x1875759226635520:12345-0@lo:104: Request processed in 83us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.108980:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863895.109000:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863895.109007:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:20087:x1875759226635648:12345-0@lo:104: 00010000:00010000:3.0:1788863895.109015:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109052:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788863895.109057:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:20087:x1875759226635648:12345-0@lo:104: Request processed in 52us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.109064:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788863895.109110:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863895.109116:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109130:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863895.109134:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109142:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863895.109150:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863895.109155:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863895.109185:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109192:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863895.109212:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109219:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3e600/0xf569beb9d4b6a1e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a1eb expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109232:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863895.109236:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109241:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863895.109244:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109261:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863895.109267:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863895.109272:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863895.109286:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109292:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863895.109297:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109303:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3f000/0xf569beb9d4b6a086 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a08d expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109312:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863895.109314:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863895.109315:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863895.109337:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226635904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863895.109365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863895.109404:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863895.109411:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226636032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863895.109431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863895.109461:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226635904 00000100:00100000:3.0:1788863895.109466:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226635904 00010000:00010000:3.0:1788863895.109486:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 24 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863895.109520:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636032 00000100:00100000:3.0:1788863895.109524:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636032 00010000:00010000:3.0:1788863895.109537:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 25 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863895.109556:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863895.109563:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+25:3640:x1875759226635904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863895.109573:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863895.109578:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 25 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109586:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 25 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109600:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863895.109628:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+25:3640:x1875759226635904:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.109635:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863895.109648:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863895.109654:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3640:x1875759226636032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863895.109661:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863895.109665:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 24 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109673:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 24 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.109681:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863895.109954:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3640:x1875759226636032:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.109961:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863895.110037:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226636032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863895.110046:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226635904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863895.110154:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863895.110255:0:20087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 23 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.110266:0:20087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 23 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.110276:0:20087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226636160:0@lo:104: 00000100:00100000:0.0:1788863895.110299:0:20087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863895.110310:0:20087:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863895.110323:0:20087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635264:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863895.110343:0:20087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a1eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a1e4 expref: 23 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.110354:0:20087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635520:0@lo:104: 00010000:00010000:0.0:1788863895.110364:0:20087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650922200/0xf569beb9d4b6a08d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a086 expref: 22 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.110371:0:20087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635648:0@lo:104: 00000100:00100000:3.0:1788863895.110585:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226635776 00000100:00100000:3.0:1788863895.110590:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226635776 00000100:00100000:3.0:1788863895.110613:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636160 00000100:00100000:3.0:1788863895.110616:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636160 00000100:00100000:3.0:1788863895.110625:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863895.110632:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:20087:x1875759226635776:12345-0@lo:104: 00010000:00010000:3.0:1788863895.110642:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114247:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863895.114264:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+4:20087:x1875759226635776:12345-0@lo:104: Request processed in 3628us (5755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.114276:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863895.114310:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863895.114322:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:20087:x1875759226636160:12345-0@lo:104: 00010000:00010000:3.0:1788863895.114340:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114406:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788863895.114413:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+3:20087:x1875759226636160:12345-0@lo:104: Request processed in 95us (4113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.114418:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788863895.114454:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863895.114461:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114469:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863895.114473:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114482:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863895.114488:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863895.114494:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863895.114530:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114536:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863895.114556:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114563:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64259b000/0xf569beb9d4b6a047 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a04e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114575:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863895.114578:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114584:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788863895.114587:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114600:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863895.114605:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863895.114610:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863895.114624:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114630:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863895.114637:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114643:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a040 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.114656:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863895.114658:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863895.114660:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863895.114946:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226636288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863895.114992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863895.115039:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863895.115046:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226636416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863895.115068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863895.115115:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636288 00000100:00100000:3.0:1788863895.115122:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636288 00010000:00010000:3.0:1788863895.115147:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 22 pid: 17055 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863895.115181:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636416 00000100:00100000:3.0:1788863895.115184:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636416 00010000:00010000:3.0:1788863895.115193:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 23 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863895.115208:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863895.115214:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:3642:x1875759226636288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863895.115225:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863895.115229:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 23 pid: 17055 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.115238:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 23 pid: 17055 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.115255:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863895.115280:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:3642:x1875759226636288:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.115285:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863895.115297:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863895.115302:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:3642:x1875759226636416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863895.115308:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863895.115312:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 22 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.115319:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 22 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.115328:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863895.115352:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:3642:x1875759226636416:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.115358:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863895.115399:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226636416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863895.115406:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226636288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863895.115422:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863895.115456:0:20087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3e400/0xf569beb9d4b6a04e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a047 expref: 21 pid: 17055 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863895.115467:0:20087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635776:0@lo:104: 00010000:00010000:3.0:1788863895.115475:0:20087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259a400/0xf569beb9d4b6a040 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a039 expref: 20 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863895.115483:0:20087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226636160:0@lo:104: 00000100:00100000:3.0:1788863895.115896:0:20087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20087:1875759226635392:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863895.115929:0:20087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863895.122335:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863895.122382:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863895.122494:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576704 00000100:00100000:0.0:1788863895.122506:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576704 00010000:00010000:0.0:1788863895.122544:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 13 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.122586:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576832 00000100:00100000:0.0:1788863895.122589:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576832 00010000:00010000:0.0:1788863895.122601:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 14 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863895.122634:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1788863895.122644:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6586cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+14:2409:x1875759205576704:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863895.122659:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863895.122676:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 14 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122688:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 14 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122705:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259bc00/0xf569beb9d4b6a37a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518831f expref: 14 pid: 17053 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122738:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863895.122790:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6586cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2409:x1875759205576704:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 147us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863895.122808:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1788863895.122862:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:0.0:1788863895.122869:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:2409:x1875759205576832:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863895.122877:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863895.122881:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 12 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122889:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 12 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122899:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a33b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882af expref: 12 pid: 17054 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122910:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122919:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122934:0:17045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122940:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122956:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122963:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122969:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259aa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788863895.122974:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122982:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.122994:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863895.123005:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863895.123026:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:2409:x1875759205576832:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 157us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863895.123033:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00010000:00010000:3.0:1788863895.123337:0:20087:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.123347:0:20087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.123353:0:20087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259aa00/0xf569beb9d4b6a3ab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863895.851581:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863896.817644:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863896.817792:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205576960 00000100:00100000:2.0:1788863896.817805:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205576960 00000100:00100000:2.0:1788863896.817864:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 150 00000100:00100000:2.0:1788863896.817876:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:14893:x1875759205576960:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863896.817893:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863896.817916:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e650923800/0xf569beb9d4b6a3b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188357 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863896.817946:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e650923800/0xf569beb9d4b6a3b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188357 expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863896.817958:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e650923800/0xf569beb9d4b6a3b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188357 expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863896.817967:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650923800, rc 0) 00000100:00100000:2.0:1788863896.818021:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:14893:x1875759205576960:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 149us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863896.818029:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 150 00000100:00100000:0.0:1788863896.823919:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863896.823995:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577088 00000100:00100000:2.0:1788863896.824005:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577088 00000100:00100000:2.0:1788863896.824054:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 151 00000100:00100000:2.0:1788863896.824063:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:14893:x1875759205577088:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863896.824732:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:14893:x1875759205577088:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 667us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863896.824769:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 151 00000100:00100000:3.0:1788863896.846019:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863896.846123:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577216 00000100:00100000:2.0:1788863896.846134:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577216 00000100:00100000:2.0:1788863896.846197:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:2.0:1788863896.846207:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:14893:x1875759205577216:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863896.846395:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:14893:x1875759205577216:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 188us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863896.846403:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:3.0:1788863896.857352:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863896.857623:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577344 00000100:00100000:1.0:1788863896.857634:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577344 00000100:00100000:1.0:1788863896.857690:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 153 00000100:00100000:1.0:1788863896.857701:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:14893:x1875759205577344:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863896.857718:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863896.857736:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b6a3b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518835e expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863896.857777:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b6a3b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518835e expref: 13 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863896.857789:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b6a3b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518835e expref: 13 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863896.857797:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fe00, rc 0) 00000100:00100000:1.0:1788863896.857857:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:14893:x1875759205577344:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 158us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863896.857864:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 153 00000100:00100000:2.0:1788863896.869316:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863896.869462:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577472 00000100:00100000:3.0:1788863896.869472:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577472 00000100:00100000:3.0:1788863896.869527:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 154 00000100:00100000:3.0:1788863896.869537:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:14893:x1875759205577472:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863896.869717:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:14893:x1875759205577472:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 181us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863896.881813:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 154 00010000:00010000:3.0:1788863896.881940:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863896.887507:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863896.887802:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577600 00000100:00100000:0.0:1788863896.887812:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577600 00000100:00100000:0.0:1788863896.887870:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 155 00000100:00100000:0.0:1788863896.887879:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:14893:x1875759205577600:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863896.888037:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:14893:x1875759205577600:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 158us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863896.888054:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 155 10000000:01000000:3.0:1788863897.003324:0:17058:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863897.003334:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5425b8000 from 13 10000000:01000000:3.0:1788863897.003341:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863897.003551:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.003563:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.003574:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863897.003600:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.003739:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863897.003792:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542577000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.003821:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636544 00000100:00100000:3.0:1788863897.003828:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636544 00000100:00100000:3.0:1788863897.003873:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788863897.003882:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:17058:x1875759226636544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863897.003896:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863897.004320:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99600/0xf569beb9d4b6a3c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a3c0 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.005548:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99600/0xf569beb9d4b6a3c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3c0 expref: 21 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.005568:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99600/0xf569beb9d4b6a3c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3c0 expref: 21 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.005577:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99600, rc 0) 00000100:00100000:3.0:1788863897.006069:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226636544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2185us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.006096:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788863897.006174:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863897.006193:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.006203:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863897.006291:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.006330:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863897.006505:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542577000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.006535:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636672 00000100:00100000:3.0:1788863897.006541:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636672 00000100:00100000:3.0:1788863897.006574:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788863897.006585:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226636672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.007325:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226636672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 740us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.007333:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788863897.007400:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.007439:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.007479:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863897.007507:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542577000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.007522:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636800 00000100:00100000:3.0:1788863897.007527:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636800 00000100:00100000:3.0:1788863897.007554:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788863897.007562:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226636800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.007673:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226636800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.007680:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788863897.007720:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788863897.010539:0:20148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788863897.010924:0:17058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788863897.010949:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863897.010961:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.010974:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863897.010998:0:17058:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863897.011001:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e67b71c000 from 13 10000000:01000000:3.0:1788863897.011004:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863897.011042:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.011050:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.011062:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863897.011114:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.011232:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863897.011282:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ec8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863897.011527:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226636928 00000100:00100000:1.0:1788863897.011535:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226636928 00000100:00100000:1.0:1788863897.011577:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788863897.011586:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:17058:x1875759226636928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863897.011601:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863897.011617:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a3d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a3ce expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863897.012142:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a3d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3ce expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863897.012158:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a3d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3ce expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863897.012167:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f600, rc 0) 00000100:00100000:1.0:1788863897.012222:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:17058:x1875759226636928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 638us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863897.012228:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788863897.012306:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226636928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863897.012321:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.012330:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863897.013205:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.013253:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863897.013299:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ec8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863897.013887:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637056 00000100:00100000:1.0:1788863897.013896:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637056 00000100:00100000:1.0:1788863897.013958:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788863897.013968:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:17058:x1875759226637056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863897.014126:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:17058:x1875759226637056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863897.014151:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788863897.014599:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.014640:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.015614:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863897.015780:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637184 00000100:00100000:1.0:1788863897.015787:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637184 00000100:00100000:1.0:1788863897.015831:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788863897.015839:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:17058:x1875759226637184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863897.015963:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:17058:x1875759226637184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863897.015970:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788863897.016782:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ec8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.016810:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788863897.019846:0:20149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788863897.020039:0:17058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788863897.020062:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788863897.020095:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863897.020109:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863897.020120:0:17058:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788863897.020122:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5425c9800 from 13 10000000:01000000:1.0:1788863897.020125:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863897.020163:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863897.020171:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863897.020182:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863897.020212:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863897.020292:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863897.020334:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae14540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.021880:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637312 00000100:00100000:3.0:1788863897.021894:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637312 00000100:00100000:3.0:1788863897.022518:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788863897.022529:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:17058:x1875759226637312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863897.022549:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863897.022566:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a3e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a3dc expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.022596:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3dc expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.022606:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3dc expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.022613:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98c00, rc 0) 00000100:00100000:3.0:1788863897.023071:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226637312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 542us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.023096:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788863897.023179:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863897.023199:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.023209:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863897.023299:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.023330:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863897.023724:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637440 00000100:00100000:0.0:1788863897.023734:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637440 00000100:00100000:0.0:1788863897.023781:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788863897.023789:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226637440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863897.023909:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226637440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863897.023916:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788863897.024598:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.024621:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863897.025999:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863897.026071:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863897.026127:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.026311:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637568 00000100:00100000:3.0:1788863897.026320:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637568 00000100:00100000:3.0:1788863897.026388:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788863897.026397:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226637568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.026519:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226637568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.026526:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788863897.026685:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788863897.032225:0:20151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788863897.032477:0:17058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788863897.032503:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863897.032516:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863897.032529:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863897.032541:0:17058:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788863897.032544:0:17058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5448c2800 from 13 10000000:01000000:2.0:1788863897.032547:0:17058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863897.032587:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863897.032608:0:17058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863897.032626:0:17058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863897.032662:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863897.032734:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863897.032804:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622240 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.034737:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637696 00000100:00100000:3.0:1788863897.034751:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637696 00000100:00100000:3.0:1788863897.034825:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788863897.034835:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:17058:x1875759226637696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863897.034851:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863897.034869:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a3f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a3ea expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.034897:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a3f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3ea expref: 24 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.035022:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a3f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a3ea expref: 24 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863897.035042:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98400, rc 0) 00000100:00100000:3.0:1788863897.035145:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226637696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.035153:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788863897.035248:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863897.035266:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863897.035293:0:17058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863897.035367:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863897.035402:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863897.035445:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808eff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.036537:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637824 00000100:00100000:3.0:1788863897.036547:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637824 00000100:00100000:3.0:1788863897.036598:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788863897.036607:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226637824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863897.036748:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226637824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.036770:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788863897.036960:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863897.037009:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863897.037056:0:17058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863897.037096:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863897.037111:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226637952 00000100:00100000:3.0:1788863897.037115:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226637952 00000100:00100000:2.0:1788863897.037925:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788863897.037934:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226637952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863897.038051:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:17058:x1875759226637952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863897.038059:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788863897.038484:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dea3065e-0e63-4370-a87c-9d4f07265d5e:17058:1875759226637952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788863897.043193:0:20152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788863897.043690:0:17058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788863897.043714:0:17058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863897.043725:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863897.043738:0:17058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863897.070659:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.070697:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.070719:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.070748:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.070781:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.070805:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.070835:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577856 00000100:00100000:3.0:1788863897.070844:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577856 00000100:00100000:3.0:1788863897.070901:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577728 00000100:00100000:3.0:1788863897.070904:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577728 00000100:00100000:3.0:1788863897.071123:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205578240 00000100:00100000:3.0:1788863897.071127:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205578240 00000100:00100000:3.0:1788863897.071146:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:3.0:1788863897.071154:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205577856:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.071237:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205577856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 82us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.071244:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:3.0:1788863897.071261:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788863897.071267:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:2411:x1875759205577728:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.071291:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:2411:x1875759205577728:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.071297:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788863897.071308:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788863897.071314:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205578240:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.071336:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205578240:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.071342:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:3.0:1788863897.071498:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205578112 00000100:00100000:3.0:1788863897.071502:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205578112 00000100:00100000:3.0:1788863897.071526:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205577984 00000100:00100000:3.0:1788863897.071529:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205577984 00000100:00100000:3.0:1788863897.071543:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205578496 00000100:00100000:3.0:1788863897.071545:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205578496 00000100:00100000:3.0:1788863897.071560:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788863897.071566:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205578112:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.071592:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205578112:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.071599:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788863897.071610:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:3.0:1788863897.071623:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e676fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205577984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.071714:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e676fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205577984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 91us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.071720:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:3.0:1788863897.071858:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:3.0:1788863897.071866:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205578496:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.071890:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205578496:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.071896:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00080000:3.0:1788863897.072547:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863897.072553:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863897.072556:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863897.072558:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863897.080483:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.080523:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863897.080550:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205578624 00000100:00100000:3.0:1788863897.080560:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205578624 00000100:00100000:3.0:1788863897.080621:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:3.0:1788863897.080630:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205578624:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.080785:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205578624:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 156us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.080794:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00080000:3.0:1788863897.080819:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863897.081104:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205578368 00000100:00100000:3.0:1788863897.081110:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205578368 00000100:00100000:3.0:1788863897.081148:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788863897.081164:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205578368:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863897.081201:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205578368:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 37us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863897.081207:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00080000:3.0:1788863897.081224:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788863897.907014:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863898.091324:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226638080:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.091395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.091452:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226638592:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.091476:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.091494:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226639104:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.091512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.091527:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226639616:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.091545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.091566:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863898.091572:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226638208:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.091594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863898.091792:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638080 00000100:00100000:0.0:1788863898.091800:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638080 00000100:00100000:0.0:1788863898.091845:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788863898.091854:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3640:x1875759226638080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.091902:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3640:x1875759226638080:12345-0@lo:400:kworker.0 Request processed in 49us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.091920:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788863898.091954:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638208 00000100:00100000:0.0:1788863898.091957:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638208 00000100:00100000:0.0:1788863898.091980:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788863898.091987:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226638208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.092018:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226638208:12345-0@lo:400:kworker.0 Request processed in 32us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.092024:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863898.092381:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226638208:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.092391:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226638720:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.092418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.092450:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226639232:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.092470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.092490:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226638080:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.092505:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863898.092520:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226639744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863898.092543:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.092575:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226638336:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.092597:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.094014:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226638848:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.094062:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.094108:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226639360:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.094131:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.094151:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788863898.094158:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226638464:0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.094759:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638720 00000100:00100000:0.0:1788863898.094768:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638720 00000100:00100000:0.0:1788863898.094816:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788863898.094825:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226638720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863898.094918:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638336 00000100:00100000:1.0:1788863898.094923:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638336 00000100:00100000:1.0:1788863898.094965:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638848 00000100:00100000:1.0:1788863898.094969:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638848 00000100:00100000:1.0:1788863898.094990:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863898.094997:0:18570:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226638336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.098988:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226638720:12345-0@lo:400:kworker.0 Request processed in 4154us (6559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.099002:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788863898.099114:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226638720:0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.100778:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863898.100799:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226638848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.100900:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226638848:12345-0@lo:400:kworker.0 Request processed in 111us (6837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.100907:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788863898.100931:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863898.106216:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638592 00000100:00100000:0.0:1788863898.106232:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638592 00000100:00100000:0.0:1788863898.106277:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226639104 00000100:00100000:0.0:1788863898.106281:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226639104 00000100:00100000:0.0:1788863898.106302:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226639616 00000100:00100000:0.0:1788863898.106305:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226639616 00000100:00100000:0.0:1788863898.106330:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226639232 00000100:00100000:0.0:1788863898.106333:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226639232 00000100:00100000:0.0:1788863898.106345:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226639360 00000100:00100000:0.0:1788863898.106347:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226639360 00000100:00100000:0.0:1788863898.106364:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788863898.106373:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226638592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.106490:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226638592:12345-0@lo:400:kworker.0 Request processed in 118us (15012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.106497:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788863898.106515:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863898.106520:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226639104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.106550:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226639104:12345-0@lo:400:kworker.0 Request processed in 30us (15037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.106556:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863898.106565:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788863898.106571:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226639616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.106597:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226639616:12345-0@lo:400:kworker.0 Request processed in 27us (15052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.106602:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788863898.106627:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863898.106633:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226639232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.106659:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226639232:12345-0@lo:400:kworker.0 Request processed in 27us (14188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.106664:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863898.106674:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863898.106685:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226639360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.106713:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226639360:12345-0@lo:400:kworker.0 Request processed in 28us (12581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.106719:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863898.106754:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863898.106770:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226639872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863898.106809:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788863898.106852:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863898.106856:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863898.106896:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226639232:0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.106907:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226638592:0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.106916:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226639104:0@lo:400:kworker.0 00010000:00080000:0.0:1788863898.106929:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543b7bb80 x1875759226639616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863898.106938:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226639616:0@lo:400:kworker.0 00000100:00100000:1.0:1788863898.107828:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226639744 00000100:00100000:1.0:1788863898.107837:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226639744 00000100:00100000:1.0:1788863898.107883:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226639872 00000100:00100000:1.0:1788863898.107886:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226639872 00000100:00100000:1.0:1788863898.107902:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788863898.107909:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226639744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863898.107936:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863898.107990:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226639744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (15446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863898.107997:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788863898.108010:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788863898.108016:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226639872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863898.108024:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863898.108047:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226639872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863898.108053:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788863898.108112:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226639744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863898.108147:0:18570:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226638336:12345-0@lo:400:kworker.0 Request processed in 13151us (15549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863898.108164:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788863898.108406:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863898.108445:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226639872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863898.109125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.109285:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638464 00000100:00100000:3.0:1788863898.109292:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638464 00000100:00100000:3.0:1788863898.109328:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863898.109336:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226638464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.109380:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226638464:12345-0@lo:400:kworker.0 Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863898.109386:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863898.109540:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226638464:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.109552:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226638976:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.109724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.109761:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226639488:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.109787:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863898.109810:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226638336:0@lo:400:kworker.0 00000100:00100000:3.0:1788863898.109821:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226638848:0@lo:400:kworker.0 00010000:00080000:3.0:1788863898.109850:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4ba300 x1875759226639360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863898.109860:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226639360:0@lo:400:kworker.0 00000100:00100000:1.0:1788863898.109968:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226638976 00000100:00100000:1.0:1788863898.109974:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226638976 00000100:00100000:1.0:1788863898.110006:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788863898.110013:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226638976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863898.110053:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226638976:12345-0@lo:400:kworker.0 Request processed in 41us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863898.110059:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788863898.110108:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226638976:0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.110350:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226639488 00000100:00100000:0.0:1788863898.110354:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226639488 00000100:00100000:0.0:1788863898.110399:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863898.110406:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226639488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863898.110522:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226639488:12345-0@lo:400:kworker.0 Request processed in 116us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863898.110528:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788863898.110784:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226639488:0@lo:400:kworker.0 00000100:00080000:3.0:1788863898.110839:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863898.603508:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863898.603899:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67adf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226640000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863898.603970:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863898.604473:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226640000 00000100:00100000:2.0:1788863898.604483:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226640000 00000100:00100000:2.0:1788863898.604812:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863898.604823:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226640000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863898.604859:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788863898.605001:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226640000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 179us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863898.605009:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863898.606906:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67adf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226640000:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788863898.923346:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863899.374823:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788863899.492928:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863899.494452:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205578752 00000100:00100000:3.0:1788863899.494466:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205578752 00000100:00080000:0.0:1788863899.494630:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863899.496156:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:3.0:1788863899.496177:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+6:15558:x1875759205578752:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863899.496199:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863899.496224:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a3f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188365 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496291:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496305:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496317:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496343:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496351:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496357:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496454:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6a40d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496462:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6a40d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496469:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6a40d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863899.496501:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788863899.496505:0:17062:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863899.496543:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6a40d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496553:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496560:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496567:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496573:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863899.496577:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496585:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496607:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:3.0:1788863899.496616:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863899.496623:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496629:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a3ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496644:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496650:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496656:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496661:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863899.496663:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496669:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496677:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89e65d52e400) 00010000:00010000:3.0:1788863899.496679:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863899.496682:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496687:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a406 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496732:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a3f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188365 expref: 8 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496760:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6a40d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188365 expref: 7 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.496767:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e65d52e300) 00010000:00010000:3.0:1788863899.496769:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863899.496772:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98600, rc 0) 00000100:00100000:3.0:1788863899.496852:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+7:15558:x1875759205578752:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 685us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863899.496859:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:3.0:1788863899.506044:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.506233:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205578880 00000100:00100000:1.0:1788863899.506244:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205578880 00000100:00100000:1.0:1788863899.506306:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:1.0:1788863899.506317:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2472872-203b-4543-b84a-9e24d2c107a6+7:15558:x1875759205578880:12345-192.168.204.35@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788863899.506403:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2472872-203b-4543-b84a-9e24d2c107a6+7:15558:x1875759205578880:12345-192.168.204.35@tcp:900:lhsmtool_posix.0 Request processed in 88us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.506411:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:2.0:1788863899.536459:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863899.537714:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205579136 00000100:00100000:0.0:1788863899.537726:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205579136 00000100:00100000:0.0:1788863899.537794:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:0.0:1788863899.537803:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+7:15558:x1875759205579136:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863899.537824:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863899.537844:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a414 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518836c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.537916:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.537931:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.537956:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.538027:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.538036:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.538042:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.538444:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b6a429 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.538466:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b6a429 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.538473:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b6a429 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863899.538484:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788863899.539453:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539464:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539471:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539477:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863899.539481:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539488:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539500:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e65d52e300) 00010000:00010000:0.0:1788863899.539503:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863899.539507:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539513:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a41b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539524:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539539:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539546:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539551:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863899.539554:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539559:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539566:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89e671b75a00) 00010000:00010000:0.0:1788863899.539568:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863899.539571:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.539577:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a422 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.546889:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a414 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518836c expref: 10 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.546919:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b6a429 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518836c expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.546929:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e671b75400) 00010000:00010000:0.0:1788863899.546932:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863899.546963:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259bc00, rc 0) 00000100:00100000:0.0:1788863899.547047:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+9:15558:x1875759205579136:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 9243us (10595us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788863899.547057:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:3.0:1788863899.568185:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.568353:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205579264 00000100:00100000:1.0:1788863899.568364:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205579264 00000100:00100000:1.0:1788863899.568433:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:1.0:1788863899.568444:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+9:15558:x1875759205579264:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788863899.568581:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+9:15558:x1875759205579264:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 138us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.568589:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:1.0:1788863899.578070:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863899.579807:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205579392 00000100:00100000:2.0:1788863899.579822:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205579392 00000100:00100000:2.0:1788863899.579924:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:2.0:1788863899.579936:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:15558:x1875759205579392:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788863899.580121:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863899.582342:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.582408:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205579520 00000100:00100000:1.0:1788863899.582423:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205579520 00000100:00100000:1.0:1788863899.582608:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:1.0:1788863899.582620:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+9:15564:x1875759205579520:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863899.582640:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863899.582662:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188373 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582734:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582747:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582760:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582776:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582783:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582789:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582852:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582860:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582867:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582873:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863899.582877:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582884:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582912:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:1.0:1788863899.582915:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863899.582921:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582928:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a43e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582943:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582948:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582954:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582966:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863899.582969:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582975:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582984:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e66270f000) 00010000:00010000:1.0:1788863899.582986:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863899.582989:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.582995:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a445 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.583029:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a437 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188373 expref: 10 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.583039:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:1.0:1788863899.583041:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863899.583044:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188373 expref: 10 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.583055:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863899.583194:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+9:15564:x1875759205579520:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 576us (867us total) trans 0 rc 301/301 00000100:00100000:1.0:1788863899.583202:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000004:00080000:2.0:1788863899.583881:0:17061:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3900us 00000100:00100000:1.0:1788863899.598152:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863899.600535:0:17069:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205579648 00000100:00100000:0.0:1788863899.600551:0:17069:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205579648 00000100:00100000:0.0:1788863899.600636:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1788863899.600647:0:17069:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f2472872-203b-4543-b84a-9e24d2c107a6+9:15564:x1875759205579648:12345-192.168.204.35@tcp:700:lfs.0 00000100:00100000:0.0:1788863899.600754:0:17069:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f2472872-203b-4543-b84a-9e24d2c107a6+9:15564:x1875759205579648:12345-192.168.204.35@tcp:700:lfs.0 Request processed in 108us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863899.600761:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1788863899.613690:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.613833:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205579904 00000100:00100000:1.0:1788863899.613842:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205579904 00000100:00100000:1.0:1788863899.613890:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:1.0:1788863899.613898:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+9:15564:x1875759205579904:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:1.0:1788863899.614028:0:17062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863899.614061:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a365 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882e0 expref: 9 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.614101:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:1.0:1788863899.614108:0:17062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863899.614166:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.614190:0:17062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 5 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.614199:0:17062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.614347:0:17062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 5 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.614364:0:17062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 5 pid: 19853 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863899.614380:0:17062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875759226640128:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863899.614477:0:17062:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67ae14f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863899.622017:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:15558:x1875759205579392:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 42072us (43944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863899.622033:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:1.0:1788863899.628034:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226640256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863899.628160:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863899.628453:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863899.628538:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863899.628545:0:17062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875759226640128:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863899.628552:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226640384:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788863899.628573:0:17062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863899.628590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863899.628633:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226640384 00000100:00100000:2.0:1788863899.628640:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226640384 00000100:00100000:1.0:1788863899.628650:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205580032 00000100:00100000:1.0:1788863899.628656:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205580032 00000100:00100000:2.0:1788863899.628693:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1788863899.628700:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 6 pid: 19853 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863899.628720:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226640384:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863899.628744:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:1.0:1788863899.628753:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2409:x1875759205580032:12345-192.168.204.35@tcp:103:ldlm_bl.0 00000004:00000024:2.0:1788863899.628760:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00010000:00010000:1.0:1788863899.628765:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863899.628773:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 6 pid: 19853 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.628785:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 6 pid: 19853 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.628884:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a3a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188350 expref: 6 pid: 19853 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.628901:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:1.0:1788863899.628906:0:17045:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.628916:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.628923:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.628946:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863899.628995:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2409:x1875759205580032:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 243us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.629003:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00080000:1.0:1788863899.629054:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863899.629062:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863899.629071:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226640512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863899.629134:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863899.629164:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226640512 00000100:00100000:1.0:1788863899.629169:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226640512 00000100:00100000:1.0:1788863899.629185:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788863899.629190:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226640512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863899.629209:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788863899.629237:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226640512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.629254:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788863899.629286:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226640512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863899.630034:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226640256 00000100:00100000:3.0:1788863899.630041:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226640256 00000100:00100000:3.0:1788863899.630152:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788863899.630162:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226640256:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863899.630178:0:17062:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1788863899.630179:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00010000:00010000:1.0:1788863899.630193:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.630219:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.630231:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.630238:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863899.630971:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226640384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2265us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863899.630981:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788863899.631363:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226640256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1201us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863899.631371:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863899.631667:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226640384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863899.631691:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226640256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863899.632643:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632659:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632669:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863899.632685:0:17062:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a639a6cf reply state 0000000037643854 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632696:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632713:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:1.0:1788863899.632717:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863899.632720:0:17062:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788863899.632726:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788863899.632735:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632741:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632749:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632755:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863899.632759:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632777:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632790:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e671b75500) 00010000:00010000:1.0:1788863899.632793:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863899.632798:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632805:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a44c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863899.632821:0:17062:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a639a6cf reply state 0000000037643854 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632830:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.632836:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e66270f000) 00010000:00010000:1.0:1788863899.632838:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788863899.632840:0:17062:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788863899.632939:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+10:15564:x1875759205579904:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 19038us (19257us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788863899.632947:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:0.0:1788863899.782281:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.782568:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205580160 00000100:00100000:1.0:1788863899.782582:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205580160 00000100:00100000:1.0:1788863899.782674:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:1.0:1788863899.782686:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+10:15572:x1875759205580160:12345-192.168.204.35@tcp:101:lctl.0 00010000:00010000:1.0:1788863899.782731:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863899.782767:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518837a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.782880:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6a468 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.782899:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6a468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.782914:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6a468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863899.782972:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788863899.782977:0:17060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788863899.783317:0:17060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6a468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.783352:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518837a expref: 12 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.783375:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6a468 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518837a expref: 11 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.783385:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:1.0:1788863899.783389:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863899.783393:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ee00, rc 0) 00000100:00100000:1.0:1788863899.783813:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+11:15572:x1875759205580160:12345-192.168.204.35@tcp:101:lctl.0 Request processed in 1126us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.783823:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:2.0:1788863899.810344:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863899.810978:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205580288 00000100:00100000:3.0:1788863899.811467:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205580288 00000100:00100000:3.0:1788863899.811672:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:3.0:1788863899.811685:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:15573:x1875759205580288:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:3.0:1788863899.811726:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863899.811754:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a46f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188381 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.811847:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a476 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.811865:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.811880:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863899.811941:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788863899.811946:0:17061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863899.811978:0:17061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.812296:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a46f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188381 expref: 7 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.812321:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a476 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188381 expref: 6 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863899.812330:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:3.0:1788863899.812334:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863899.812338:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98000, rc 0) 00000100:00100000:3.0:1788863899.812838:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15573:x1875759205580288:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1152us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863899.812863:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:1.0:1788863899.816928:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863899.817814:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205580416 00000100:00100000:0.0:1788863899.817830:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205580416 00000100:00100000:0.0:1788863899.817963:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:0.0:1788863899.817975:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:15573:x1875759205580416:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863899.818019:0:19853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863899.818045:0:19853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a47d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188388 expref: -99 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818184:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818201:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818214:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818227:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818234:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818242:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818345:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a492 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818353:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818360:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863899.818698:0:19853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788863899.818713:0:19853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863899.818744:0:19853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818775:0:19853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818781:0:19853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818789:0:19853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818795:0:19853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863899.818800:0:19853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818809:0:19853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818824:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:0.0:1788863899.818827:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863899.818833:0:19853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818840:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818856:0:19853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818863:0:19853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818869:0:19853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818881:0:19853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259aa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863899.818885:0:19853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818891:0:19853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818900:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e66270f000) 00010000:00010000:0.0:1788863899.818902:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863899.818905:0:19853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818911:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a48b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818944:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a47d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188388 expref: 8 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818960:0:19853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188388 expref: 7 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.818967:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:0.0:1788863899.818969:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863899.818971:0:19853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259ba00, rc 0) 00000100:00100000:0.0:1788863899.819359:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+7:15573:x1875759205580416:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1384us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863899.819369:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:3.0:1788863899.823028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.823130:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205580544 00000100:00100000:1.0:1788863899.823160:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205580544 00000100:00100000:1.0:1788863899.823248:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:1.0:1788863899.823261:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:15573:x1875759205580544:12345-192.168.204.35@tcp:900:lfs.0 00000100:00080000:2.0:1788863899.823613:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863899.823972:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:15573:x1875759205580544:12345-192.168.204.35@tcp:900:lfs.0 Request processed in 710us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.823983:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1788863899.828068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.828312:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205580800 00000100:00100000:1.0:1788863899.828325:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205580800 00000100:00100000:1.0:1788863899.828413:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:1.0:1788863899.828425:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+7:15573:x1875759205580800:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863899.828453:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863899.828482:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518838f expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863899.828621:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788863899.828765:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a499 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518838f expref: 9 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.828781:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:1.0:1788863899.828785:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863899.828791:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518838f expref: 9 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.828808:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788863899.828875:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+8:15573:x1875759205580800:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 453us (821us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788863899.828883:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:0.0:1788863899.833831:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.833961:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205581056 00000100:00100000:1.0:1788863899.833976:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205581056 00000100:00100000:1.0:1788863899.834328:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:1.0:1788863899.834340:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+8:15573:x1875759205581056:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:1.0:1788863899.834494:0:17060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863899.834530:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a492 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188388 expref: 8 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.834553:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:1.0:1788863899.834559:0:17060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863899.834655:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.834674:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.834687:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863899.835733:0:17060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c70026f reply state 00000000c2b00eab transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.835759:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.835767:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:1.0:1788863899.835770:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788863899.835773:0:17060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788863899.835784:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788863899.835905:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+9:15573:x1875759205581056:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 1563us (2085us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788863899.835933:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:2.0:1788863899.838925:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863899.839049:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205581312 00000100:00100000:0.0:1788863899.839062:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205581312 00000100:00100000:0.0:1788863899.839162:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:0.0:1788863899.839173:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+9:15573:x1875759205581312:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788863899.839771:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+10:15573:x1875759205581312:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 597us (857us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788863899.839781:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1788863899.844260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.844439:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205581568 00000100:00100000:1.0:1788863899.844454:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205581568 00000100:00100000:1.0:1788863899.844536:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:1.0:1788863899.844547:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+10:15573:x1875759205581568:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863899.844579:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863899.844618:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6a4ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188396 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.844724:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.844744:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.844758:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.844772:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.844779:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.844787:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863899.844915:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788863899.845014:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845045:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845053:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845059:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863899.845065:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845116:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845133:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:1.0:1788863899.845136:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863899.845142:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845147:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f000/0xf569beb9d4b6a4b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845162:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845168:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845174:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845180:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863899.845201:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845208:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845217:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e66270f000) 00010000:00010000:1.0:1788863899.845220:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863899.845223:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845230:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845272:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6a4ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188396 expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845283:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:1.0:1788863899.845285:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863899.845289:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6a4ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188396 expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.845301:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e200, rc 0) 00000100:00100000:1.0:1788863899.845375:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+11:15573:x1875759205581568:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 831us (1131us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788863899.845383:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:2.0:1788863899.850742:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863899.850948:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205581696 00000100:00100000:0.0:1788863899.850964:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205581696 00000100:00100000:0.0:1788863899.851051:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:0.0:1788863899.851062:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+11:15573:x1875759205581696:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1788863899.851120:0:19853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863899.851150:0:19853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a4ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518839d expref: -99 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.851302:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.851322:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.851337:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863899.851367:0:19853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788863899.851372:0:19853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863899.851397:0:19853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.853737:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a4ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 13 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.853793:0:19853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 12 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863899.853806:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:0.0:1788863899.853809:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863899.853814:0:19853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259aa00, rc 0) 00000100:00100000:0.0:1788863899.853925:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+12:15573:x1875759205581696:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 2862us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863899.853936:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:2.0:1788863899.860331:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863899.860448:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205581824 00000100:00100000:3.0:1788863899.860462:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205581824 00000100:00100000:3.0:1788863899.860530:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:3.0:1788863899.860541:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+12:15573:x1875759205581824:12345-192.168.204.35@tcp:37:lfs.0 00000100:00100000:0.0:1788863899.873524:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+12:15573:x1875759205581824:12345-192.168.204.35@tcp:37:lfs.0 Request processed in 12966us (13188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863899.873543:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:0.0:1788863899.886200:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.886315:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205582080 00000100:00100000:1.0:1788863899.886330:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205582080 00000100:00100000:1.0:1788863899.886400:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:1.0:1788863899.886422:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+12:15573:x1875759205582080:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863899.886780:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+13:15573:x1875759205582080:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 359us (593us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788863899.886789:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00010000:00010000:3.0:1788863899.947518:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863899.967842:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.968189:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205582208 00000100:00100000:1.0:1788863899.968203:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205582208 00000100:00100000:1.0:1788863899.968284:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:1.0:1788863899.968296:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+11:15579:x1875759205582208:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863899.968323:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863899.968351:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883a4 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.968512:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.968533:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.968546:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.968559:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.968567:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.968573:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970755:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a4ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970788:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970802:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863899.970860:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788863899.970865:0:17062:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863899.970920:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970936:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970944:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970951:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970958:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863899.970962:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.970971:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971509:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:2.0:1788863899.971512:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863899.971519:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971526:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031c00/0xf569beb9d4b6a4df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971545:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971552:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971558:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971564:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863899.971567:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971573:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971582:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e66270f000) 00010000:00010000:2.0:1788863899.971585:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863899.971661:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971668:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030600/0xf569beb9d4b6a4e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971743:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030c00/0xf569beb9d4b6a4d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883a4 expref: 13 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971761:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a4ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883a4 expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863899.971769:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:2.0:1788863899.971771:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788863899.971773:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650923600, rc 0) 00000100:00100000:2.0:1788863899.973453:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+12:15579:x1875759205582208:12345-192.168.204.35@tcp:101:bash.0 Request processed in 5143us (5611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863899.973470:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:3.0:1788863899.980862:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.982044:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205582336 00000100:00100000:1.0:1788863899.982103:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205582336 00000100:00100000:1.0:1788863899.982186:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788863899.982211:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2472872-203b-4543-b84a-9e24d2c107a6+5:15579:x1875759205582336:12345-192.168.204.35@tcp:900:bash.0 00000100:00100000:1.0:1788863899.982339:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2472872-203b-4543-b84a-9e24d2c107a6+5:15579:x1875759205582336:12345-192.168.204.35@tcp:900:bash.0 Request processed in 132us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.982349:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:0.0:1788863899.989327:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.989503:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205582592 00000100:00100000:1.0:1788863899.989518:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205582592 00000100:00100000:1.0:1788863899.989599:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:1.0:1788863899.989610:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+12:15579:x1875759205582592:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863899.989637:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863899.989666:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030e00/0xf569beb9d4b6a4f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883ab expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.989823:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.989844:0:17060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 12 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.989855:0:17060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.989902:0:17060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 12 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863899.989919:0:17060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 12 pid: 19853 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863899.989958:0:17060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17060:1875759226640640:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863899.990132:0:17060:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642bfa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863899.995032:0:17060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17060:1875759226640640:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863899.995112:0:17060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863899.995859:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863899.999889:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205582720 00000100:00100000:1.0:1788863899.999910:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205582720 00010000:00010000:1.0:1788863899.999984:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 13 pid: 19853 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863900.000045:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:1.0:1788863900.000056:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+13:2408:x1875759205582720:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863900.000123:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863900.000133:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 13 pid: 19853 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.000148:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 13 pid: 19853 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.000176:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a4d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518839d expref: 13 pid: 19853 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.000210:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:1.0:1788863900.000218:0:17046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.000246:0:17046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.000255:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.000287:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863900.000370:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+12:2408:x1875759205582720:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 315us (4516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863900.000378:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00010000:00010000:0.0:1788863900.001869:0:17060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.001889:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.001928:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.001945:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.001958:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.003998:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.004030:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.004044:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863900.004058:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788863900.004109:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.004647:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.004657:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.004664:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863900.004669:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.004678:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.004694:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:0.0:1788863900.010865:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863900.010885:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.010928:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031000/0xf569beb9d4b6a4fb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863900.010962:0:17060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086346aff reply state 00000000a78cf5bd transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.010984:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.010995:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89e671b75a00) 00010000:00010000:0.0:1788863900.010998:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863900.011002:0:17060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788863900.011097:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030e00/0xf569beb9d4b6a4f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 15 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.011116:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 14 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863900.011125:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863900.011127:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788863900.011130:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259b000, rc 0) 00000100:00100000:0.0:1788863900.011515:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+15:15579:x1875759205582592:12345-192.168.204.35@tcp:101:bash.0 Request processed in 21902us (22199us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788863900.011525:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:0.0:1788863900.038873:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863900.039000:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205582848 00000100:00100000:3.0:1788863900.039014:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205582848 00000100:00100000:2.0:1788863900.039232:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:2.0:1788863900.039249:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+15:15579:x1875759205582848:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788863900.039284:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863900.039310:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a517 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883b2 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.039527:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a51e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.039549:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.039564:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863900.039671:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788863900.039677:0:17062:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863900.039711:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.039723:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.039753:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a517 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883b2 expref: 17 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.039774:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a51e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883b2 expref: 16 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.039783:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863900.039786:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863900.039790:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922c00, rc 0) 00000100:00100000:2.0:1788863900.039870:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+16:15579:x1875759205582848:12345-192.168.204.35@tcp:101:bash.0 Request processed in 626us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863900.039878:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:3.0:1788863900.044257:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863900.044463:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205583104 00000100:00100000:1.0:1788863900.044477:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205583104 00000100:00100000:1.0:1788863900.044549:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:1.0:1788863900.044561:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+16:15579:x1875759205583104:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:1.0:1788863900.045211:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+17:15579:x1875759205583104:12345-192.168.204.35@tcp:35:bash.0 Request processed in 648us (967us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788863900.045221:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000040:00080000:2.0:1788863900.205899:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788863900.234996:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863900.236831:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205583360 00000100:00100000:1.0:1788863900.236850:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205583360 00000100:00100000:1.0:1788863900.237139:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:1.0:1788863900.237152:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+17:15589:x1875759205583360:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863900.237187:0:19853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863900.237215:0:19853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b6a525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883b9 expref: -99 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863900.237362:0:19853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788863900.237511:0:19853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b6a525 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883b9 expref: 19 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.237547:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:1.0:1788863900.237550:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863900.237570:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031600/0xf569beb9d4b6a525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883b9 expref: 19 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.237590:0:19853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031600, rc 0) 00000100:00100000:1.0:1788863900.237679:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+18:15589:x1875759205583360:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 530us (2701us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788863900.237687:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:0.0:1788863900.245218:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863900.245717:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205583616 00000100:00100000:3.0:1788863900.245733:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205583616 00000100:00100000:3.0:1788863900.245852:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1788863900.245864:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+18:15589:x1875759205583616:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788863900.246214:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+19:15589:x1875759205583616:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 351us (1011us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788863900.246222:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1788863900.317071:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863900.317554:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205583872 00000100:00100000:2.0:1788863900.317570:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205583872 00000100:00100000:2.0:1788863900.317655:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:2.0:1788863900.317667:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+19:15592:x1875759205583872:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863900.317712:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863900.317742:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a533 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883c0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.317915:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a53a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.317934:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a53a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.317948:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a53a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863900.317962:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788863900.318371:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a533 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883c0 expref: 22 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.318396:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a53a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883c0 expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.318406:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863900.318410:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863900.318415:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922600, rc 0) 00000100:00100000:2.0:1788863900.318505:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+21:15592:x1875759205583872:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 840us (1447us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788863900.318513:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:0.0:1788863900.342841:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863900.342930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863900.343049:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205584000 00000100:00100000:1.0:1788863900.343064:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205584000 00000100:00100000:1.0:1788863900.343198:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:1.0:1788863900.343211:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+21:2409:x1875759205584000:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863900.343232:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863900.343266:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a53a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883c0 expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.343292:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:1.0:1788863900.343299:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863900.343377:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+20:2409:x1875759205584000:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 169us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863900.343386:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:2.0:1788863900.343535:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205584128 00000100:00100000:2.0:1788863900.343542:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205584128 00000100:00100000:2.0:1788863900.343591:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:2.0:1788863900.343600:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+20:15592:x1875759205584128:12345-192.168.204.35@tcp:54:lfs.0 00010000:00010000:2.0:1788863900.343675:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343714:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343728:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343778:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343787:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343795:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343801:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863900.343806:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343815:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343824:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863900.343827:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863900.343832:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.343838:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a548 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863900.343884:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+20:15592:x1875759205584128:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 285us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863900.343897:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:0.0:1788863900.351579:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863900.351704:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205584384 00000100:00100000:1.0:1788863900.351719:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205584384 00000100:00100000:1.0:1788863900.351796:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788863900.351829:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+20:15592:x1875759205584384:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863900.352288:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+21:15592:x1875759205584384:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 461us (722us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788863900.352298:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000040:00080000:1.0:1788863900.397973:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788863900.853022:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863900.853206:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205584640 00000100:00100000:2.0:1788863900.853222:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205584640 00000100:00100000:2.0:1788863900.853306:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:2.0:1788863900.853317:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+21:15623:x1875759205584640:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:2.0:1788863900.853343:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863900.853368:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a54f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883c7 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.853474:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a556 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.853489:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.853500:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863900.853511:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788863900.853628:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a54f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883c7 expref: 24 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.853649:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a556 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883c7 expref: 23 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863900.853658:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863900.853660:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863900.853663:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922600, rc 0) 00000100:00100000:2.0:1788863900.853753:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+23:15623:x1875759205584640:12345-192.168.204.35@tcp:101:cat.0 Request processed in 436us (745us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788863900.853760:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:0.0:1788863900.871984:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863900.872212:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863900.872309:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205585024 00000100:00100000:1.0:1788863900.872323:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205585024 00000100:00100000:1.0:1788863900.872422:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:1.0:1788863900.872434:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2472872-203b-4543-b84a-9e24d2c107a6+23:2408:x1875759205585024:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863900.872454:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863900.872487:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a556 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883c7 expref: 23 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863900.872510:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:1.0:1788863900.872516:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863900.872592:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2472872-203b-4543-b84a-9e24d2c107a6+22:2408:x1875759205585024:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 161us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863900.872600:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:3.0:1788863900.884909:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205584896 00000100:00100000:3.0:1788863900.884930:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205584896 00000100:00100000:3.0:1788863900.885097:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:3.0:1788863900.885110:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+22:15623:x1875759205584896:12345-192.168.204.35@tcp:35:cat.0 00000100:00100000:3.0:1788863900.885552:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+23:15623:x1875759205584896:12345-192.168.204.35@tcp:35:cat.0 Request processed in 436us (13572us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788863900.885588:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00010000:00010000:0.0:1788863900.975108:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863901.051207:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863901.051504:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205585280 00000100:00100000:2.0:1788863901.051519:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205585280 00000100:00080000:1.0:1788863901.051672:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863901.051774:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:2.0:1788863901.051789:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+23:15629:x1875759205585280:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788863901.051822:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863901.051851:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a564 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883ce expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.053213:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.053242:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.053258:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863901.053278:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788863901.061258:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a564 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 26 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863901.061299:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 25 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863901.061311:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863901.061314:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863901.061319:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922200, rc 0) 00000100:00100000:3.0:1788863901.062351:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+25:15629:x1875759205585280:12345-192.168.204.35@tcp:101:dd.0 Request processed in 10556us (11150us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788863901.062376:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:0.0:1788863901.070016:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863901.070186:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863901.070454:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205585536 00000100:00100000:2.0:1788863901.070468:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205585536 00000100:00100000:2.0:1788863901.070536:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:2.0:1788863901.070548:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+25:15629:x1875759205585536:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788863901.070588:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863901.070615:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a579 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883d5 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.070700:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.070718:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.070733:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.070876:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a579 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 27 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.070899:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 26 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.070909:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863901.070913:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788863901.070917:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922600, rc 0) 00000100:00100000:2.0:1788863901.071016:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+26:15629:x1875759205585536:12345-192.168.204.35@tcp:101:dd.0 Request processed in 470us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863901.071024:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:0.0:1788863901.074828:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863901.077261:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205585792 00000100:00100000:2.0:1788863901.077285:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205585792 00000100:00100000:2.0:1788863901.077561:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:2.0:1788863901.077587:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+26:15629:x1875759205585792:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:2.0:1788863901.077663:0:19853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863901.077710:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a51e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883b2 expref: 26 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.077757:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863901.077764:0:19853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863901.077998:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.078017:0:19853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 26 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.078027:0:19853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.078072:0:19853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 26 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.078125:0:19853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 26 pid: 17060 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863901.078143:0:19853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19853:1875759226640768:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863901.078264:0:19853:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863901.081596:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205585408 00000100:00100000:1.0:1788863901.081619:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205585408 00010000:00010000:1.0:1788863901.081702:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 27 pid: 17060 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863901.081760:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1788863901.081772:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+27:2409:x1875759205585408:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863901.081814:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863901.081823:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 27 pid: 17060 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863901.081840:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 27 pid: 17060 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863901.081869:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:1.0:1788863901.081876:0:17045:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863901.081889:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863901.081899:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863901.081927:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863901.082015:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+27:2409:x1875759205585408:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 244us (12013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863901.082023:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00010000:00010000:2.0:1788863901.091909:0:19853:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.35@tcp) returned -22 from blocking AST (req@000000003da262e1 x1875759226640768) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 26 pid: 17060 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.091941:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a56b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ce expref: 26 pid: 17060 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863901.091963:0:19853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19853:1875759226640768:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863901.092014:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863901.092025:0:19853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.092036:0:19853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.092043:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863901.092210:0:19853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788863901.092276:0:19853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da356484 reply state 0000000084f7557c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.092294:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.092303:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863901.092306:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788863901.092309:0:19853:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863901.092735:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+27:15629:x1875759205585792:12345-192.168.204.35@tcp:36:dd.0 Request processed in 15159us (17922us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788863901.092746:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00000020:00080000:2.0:1788863901.092754:0:19853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788863901.234766:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863901.234885:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205586048 00000100:00100000:0.0:1788863901.234899:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205586048 00000100:00100000:0.0:1788863901.234977:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:0.0:1788863901.234988:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+27:15629:x1875759205586048:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:0.0:1788863901.235352:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+28:15629:x1875759205586048:12345-192.168.204.35@tcp:35:dd.0 Request processed in 364us (601us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1788863901.235362:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:0.0:1788863901.882388:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863901.882540:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205586176 00000100:00100000:2.0:1788863901.882555:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205586176 00000100:00100000:2.0:1788863901.882644:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:2.0:1788863901.882667:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+28:15643:x1875759205586176:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:2.0:1788863901.882713:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863901.882749:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a58e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883dc expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.882883:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.882903:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.882922:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.882936:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.882944:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.882953:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883058:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bca00/0xf569beb9d4b6a5a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883068:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bca00/0xf569beb9d4b6a5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883127:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bca00/0xf569beb9d4b6a5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863901.883186:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788863901.883192:0:17062:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863901.883242:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bca00/0xf569beb9d4b6a5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883268:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bca00/0xf569beb9d4b6a5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883278:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883286:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883293:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883300:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bc800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863901.883305:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883315:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883330:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:2.0:1788863901.883333:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863901.883341:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883348:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a595 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883367:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883373:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883386:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883391:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bce00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863901.883393:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883399:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883407:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89e671b75a00) 00010000:00010000:2.0:1788863901.883409:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863901.883412:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883417:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a59c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883451:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a58e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883dc expref: 30 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883466:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bca00/0xf569beb9d4b6a5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883dc expref: 29 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863901.883472:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863901.883475:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863901.883477:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bca00, rc 0) 00000100:00100000:2.0:1788863901.883567:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+29:15643:x1875759205586176:12345-192.168.204.35@tcp:101:stat.0 Request processed in 912us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863901.883585:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 46 00010000:00010000:3.0:1788863902.004042:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863902.018733:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863902.028805:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205586432 00000100:00100000:0.0:1788863902.028834:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205586432 00000100:00100000:0.0:1788863902.029677:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:0.0:1788863902.029693:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+29:15649:x1875759205586432:12345-192.168.204.35@tcp:36:truncate.0 00010000:00010000:0.0:1788863902.029775:0:17060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863902.029810:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bca00/0xf569beb9d4b6a5a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883dc expref: 29 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.029838:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863902.029873:0:17060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863902.030181:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.030214:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.030229:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863902.030288:0:17060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1788863902.030317:0:17060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e0fd0e9 reply state 00000000e04225e3 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.030332:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.030351:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863902.030355:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788863902.030358:0:17060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863902.030544:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+31:15649:x1875759205586432:12345-192.168.204.35@tcp:36:truncate.0 Request processed in 854us (11829us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788863902.030554:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 47 00000020:00080000:0.0:1788863902.030561:0:17060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788863902.197247:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.197311:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.197362:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.197396:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.197440:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205586816 00000100:00100000:1.0:1788863902.197456:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205586816 00000100:00100000:1.0:1788863902.197555:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205587328 00000100:00100000:1.0:1788863902.197559:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205587328 00000100:00100000:1.0:1788863902.197590:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:1.0:1788863902.197602:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205586816:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863902.197711:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205586816:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 110us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.197722:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:1.0:1788863902.197743:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:1.0:1788863902.197751:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205587328:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863902.197774:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205587328:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.197779:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00080000:1.0:1788863902.197804:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863902.197837:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.197868:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205587072 00000100:00100000:1.0:1788863902.197871:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205587072 00000100:00100000:1.0:1788863902.197908:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205586688 00000100:00100000:1.0:1788863902.197912:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205586688 00000100:00100000:1.0:1788863902.197932:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:1.0:1788863902.197938:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+12:2411:x1875759205587072:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863902.197974:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+12:2411:x1875759205587072:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 36us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.197981:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:1.0:1788863902.197993:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:1.0:1788863902.197998:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205586688:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863902.198027:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205586688:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.198041:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00080000:1.0:1788863902.198058:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863902.198061:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863902.198180:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.198228:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.198241:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205587200 00000100:00100000:1.0:1788863902.198245:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205587200 00000100:00100000:1.0:1788863902.198267:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:1.0:1788863902.198272:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205587200:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863902.198294:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205587200:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.198299:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00080000:1.0:1788863902.198311:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863902.198357:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.198370:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205586944 00000100:00100000:1.0:1788863902.198373:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205586944 00000100:00100000:1.0:1788863902.198392:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205587456 00000100:00100000:1.0:1788863902.198394:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205587456 00000100:00100000:1.0:1788863902.198405:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:1.0:1788863902.198411:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205586944:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863902.198432:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2411:x1875759205586944:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 22us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.198438:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:1.0:1788863902.198448:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:1.0:1788863902.198453:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205587456:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863902.198471:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205587456:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 17us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.198482:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00080000:1.0:1788863902.198497:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863902.200056:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205586560 00000100:00100000:3.0:1788863902.200071:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205586560 00000100:00100000:3.0:1788863902.200223:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 169 00000100:00100000:3.0:1788863902.200234:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2411:x1875759205586560:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863902.200334:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2411:x1875759205586560:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 103us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863902.200343:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 169 00000100:00100000:1.0:1788863902.398482:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863902.398667:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205587584 00000100:00100000:2.0:1788863902.398684:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205587584 00000100:00100000:2.0:1788863902.398767:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:2.0:1788863902.398780:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+31:15663:x1875759205587584:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:2.0:1788863902.398818:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863902.398849:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a5b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883e3 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.398938:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.398958:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.398973:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.398985:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.398993:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399000:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399130:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399162:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399169:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863902.399242:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788863902.399247:0:17061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788863902.399270:0:17061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399284:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399294:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399301:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399309:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399315:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bce00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863902.399320:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399329:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399343:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:2.0:1788863902.399354:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863902.399361:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399367:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a5b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399385:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399391:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399398:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399403:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bc800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788863902.399406:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399413:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399422:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89e671b75a00) 00010000:00010000:2.0:1788863902.399424:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863902.399427:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399433:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399463:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a5b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 33 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399490:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 32 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.399498:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863902.399501:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863902.399503:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bd800, rc 0) 00000100:00100000:2.0:1788863902.400660:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+32:15663:x1875759205587584:12345-192.168.204.35@tcp:101:stat.0 Request processed in 1860us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863902.400674:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:3.0:1788863902.563573:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863902.563777:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205587840 00000100:00100000:2.0:1788863902.563791:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205587840 00000100:00100000:2.0:1788863902.563863:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:2.0:1788863902.563875:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+32:15673:x1875759205587840:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788863902.563904:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863902.563931:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a5cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883ea expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863902.564071:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788863902.564244:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a5cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ea expref: 34 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.564265:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:2.0:1788863902.564269:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863902.564274:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a5cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ea expref: 34 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.564313:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bc200, rc 0) 00000100:00100000:2.0:1788863902.564457:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+33:15673:x1875759205587840:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 584us (896us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788863902.564466:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:0.0:1788863902.572420:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.572685:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205588096 00000100:00100000:1.0:1788863902.572700:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205588096 00000100:00100000:1.0:1788863902.572814:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1788863902.572827:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f816c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+33:15673:x1875759205588096:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788863902.573588:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f816c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+34:15673:x1875759205588096:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 758us (1175us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788863902.573608:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1788863902.672062:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863902.672489:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205588352 00000100:00100000:2.0:1788863902.672504:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205588352 00000100:00100000:2.0:1788863902.672600:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:2.0:1788863902.672614:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+34:15679:x1875759205588352:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788863902.672656:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863902.672686:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a5db lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883f1 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.672847:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.672866:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 35 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.672876:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 35 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.672885:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.672926:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 35 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.672964:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 35 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863902.672979:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226640896:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863902.673449:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 35 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.673461:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 35 pid: 17060 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863902.673471:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226641024:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863902.673504:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863902.687856:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863902.688136:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863902.688235:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226640896:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863902.688250:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226641024:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788863902.688289:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.689327:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205588480 00000100:00100000:1.0:1788863902.689340:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205588480 00010000:00010000:1.0:1788863902.689404:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 36 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.689484:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205588608 00000100:00100000:1.0:1788863902.689489:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205588608 00010000:00010000:1.0:1788863902.689501:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 37 pid: 17060 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863902.689552:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:2.0:1788863902.689565:0:17047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6586c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2472872-203b-4543-b84a-9e24d2c107a6+37:2408:x1875759205588480:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863902.689714:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863902.689724:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 37 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.689740:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 37 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.689785:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd800/0xf569beb9d4b6a5c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883e3 expref: 37 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.689805:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863902.689811:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.689821:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.689828:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863902.689911:0:17047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6586c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2472872-203b-4543-b84a-9e24d2c107a6+36:2408:x1875759205588480:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 349us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863902.689920:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:2.0:1788863902.689996:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:2.0:1788863902.690004:0:17047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2472872-203b-4543-b84a-9e24d2c107a6+35:2408:x1875759205588608:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863902.690013:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863902.690018:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 35 pid: 17060 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.690028:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 35 pid: 17060 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.690041:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a509 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ab expref: 35 pid: 17060 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.691359:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:2.0:1788863902.691372:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.691387:0:17047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.691398:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863902.691439:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863902.691506:0:17047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2472872-203b-4543-b84a-9e24d2c107a6+34:2408:x1875759205588608:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 1497us (3364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863902.691516:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00010000:00010000:3.0:1788863902.691674:0:17061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.691684:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863902.691723:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788863902.691919:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc200/0xf569beb9d4b6a5db lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 35 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.691951:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 34 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.691960:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863902.691963:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788863902.691965:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bc800, rc 0) 00000100:00100000:3.0:1788863902.691994:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+34:15679:x1875759205588352:12345-192.168.204.35@tcp:101:bash.0 Request processed in 19385us (19950us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788863902.692002:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:3.0:1788863902.695344:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863902.695419:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205588864 00000100:00100000:3.0:1788863902.695432:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205588864 00000100:00100000:3.0:1788863902.695497:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:3.0:1788863902.695507:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+34:15679:x1875759205588864:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:3.0:1788863902.696227:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.696252:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.696267:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863902.696336:0:17062:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788863902.696356:0:17062:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f6b4750 reply state 00000000ec523cfc transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.696370:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.696379:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863902.696383:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863902.696387:0:17062:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863902.696502:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+37:15679:x1875759205588864:12345-192.168.204.35@tcp:36:bash.0 Request processed in 993us (1180us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788863902.696511:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00000020:00080000:3.0:1788863902.696518:0:17062:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788863902.699592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863902.699747:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205588992 00000100:00100000:0.0:1788863902.699762:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205588992 00000100:00100000:0.0:1788863902.699840:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788863902.699853:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+37:15679:x1875759205588992:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863902.699905:0:19853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863902.699945:0:19853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a5f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883f8 expref: -99 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.700019:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f8 expref: 38 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.700038:0:19853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f8 expref: 38 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.700061:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863902.700217:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863902.700223:0:19853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a600, rc 0) 00000100:00100000:0.0:1788863902.700300:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+38:15679:x1875759205588992:12345-192.168.204.35@tcp:101:bash.0 Request processed in 449us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863902.700308:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788863902.711880:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.711979:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205589120 00000100:00100000:1.0:1788863902.712007:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205589120 00000100:00100000:1.0:1788863902.712131:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:1.0:1788863902.712142:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+38:15679:x1875759205589120:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788863902.712171:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863902.712198:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b6a5fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251883ff expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.712345:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.712367:0:17060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 39 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.712376:0:17060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.712420:0:17060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 39 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.712436:0:17060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 39 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.712454:0:17060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17060:1875759226641152:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863902.712718:0:17060:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c148180 going to sleep for 11 seconds 00000100:00100000:1.0:1788863902.716774:0:17060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17060:1875759226641152:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863902.716817:0:17060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863902.719031:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863902.719596:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205589248 00000100:00100000:1.0:1788863902.719611:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205589248 00010000:00010000:1.0:1788863902.719673:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 40 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.719722:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1788863902.719748:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+40:2409:x1875759205589248:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863902.719768:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863902.719775:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 40 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.719791:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 40 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.719817:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc800/0xf569beb9d4b6a5e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f1 expref: 40 pid: 17061 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.719836:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:1.0:1788863902.719842:0:17045:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.719854:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.719862:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.719895:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863902.719956:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+39:2409:x1875759205589248:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 210us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863902.719964:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00010000:00010000:0.0:1788863902.720660:0:17060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.720672:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863902.720744:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788863902.720750:0:17060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788863902.720775:0:17060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.720831:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031400/0xf569beb9d4b6a5fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ff expref: 39 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.720853:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ff expref: 38 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.720862:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863902.720865:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863902.720868:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031800, rc 0) 00000100:00100000:0.0:1788863902.722517:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+38:15679:x1875759205589120:12345-192.168.204.35@tcp:101:bash.0 Request processed in 8785us (9059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863902.722544:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:0.0:1788863902.728818:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863902.728920:0:17814:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205589504 00000100:00100000:3.0:1788863902.728943:0:17814:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205589504 00000100:00100000:3.0:1788863902.729020:0:17814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1788863902.729033:0:17814:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2472872-203b-4543-b84a-9e24d2c107a6+38:15679:x1875759205589504:12345-192.168.204.35@tcp:103:bash.0 00010000:00010000:3.0:1788863902.729052:0:17814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788863902.729124:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a600/0xf569beb9d4b6a5f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883f8 expref: 38 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.729154:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640031800/0xf569beb9d4b6a605 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883ff expref: 37 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.729168:0:17814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863902.729193:0:17814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863902.729264:0:17814:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2472872-203b-4543-b84a-9e24d2c107a6+36:15679:x1875759205589504:12345-192.168.204.35@tcp:103:bash.0 Request processed in 233us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863902.729272:0:17814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1788863902.732972:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863902.733106:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205589632 00000100:00100000:0.0:1788863902.733121:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205589632 00000100:00100000:0.0:1788863902.733194:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:0.0:1788863902.733205:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+36:15679:x1875759205589632:12345-192.168.204.35@tcp:58:bash.0 00010000:00010000:0.0:1788863902.733348:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.733370:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.733386:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863902.735809:0:19853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863902.736238:0:19853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788863902.736712:0:19853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788863902.736858:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+36:15679:x1875759205589632:12345-192.168.204.35@tcp:58:bash.0 Request processed in 3646us (3892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863902.736882:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:0.0:1788863902.740273:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863902.740378:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205589760 00000100:00100000:3.0:1788863902.740391:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205589760 00000100:00100000:3.0:1788863902.740470:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:3.0:1788863902.740483:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+36:15679:x1875759205589760:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863902.740511:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863902.740550:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188406 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.740627:0:17062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.740640:0:17062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 37 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.740676:0:17062:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.740694:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 37 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.740711:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863902.740714:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863902.740718:0:17062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 37 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.740743:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98e00, rc 0) 00000100:00100000:3.0:1788863902.740829:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+37:15679:x1875759205589760:12345-192.168.204.35@tcp:101:bash.0 Request processed in 349us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863902.740837:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 55 00010000:00010000:0.0:1788863903.020188:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863903.214177:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226641408:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863903.214319:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226641920:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214344:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863903.214359:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226642432:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863903.214427:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863903.214433:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226641536:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214461:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863903.214478:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226642048:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214498:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863903.214514:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226642560:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863903.214574:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642432 00000100:00100000:3.0:1788863903.214586:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642432 00000100:00100000:3.0:1788863903.214670:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642560 00000100:00100000:3.0:1788863903.214674:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642560 00000100:00100000:3.0:1788863903.214702:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788863903.214715:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226642432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214784:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226642432:12345-0@lo:400:kworker.0 Request processed in 73us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.214811:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788863903.214832:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788863903.214838:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226642560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214866:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226642560:12345-0@lo:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.214872:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788863903.214909:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542ae7100 x1875759226642560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863903.214926:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226642560:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.214938:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226642432:0@lo:400:kworker.0 00000100:00100000:2.0:1788863903.215236:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863903.215251:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226642944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863903.215291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863903.215326:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642944 00000100:00100000:2.0:1788863903.215330:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642944 00000100:00100000:2.0:1788863903.215366:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863903.215374:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226642944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863903.215401:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863903.215440:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226642944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.215448:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863903.215482:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226642944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863903.215644:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226641280:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.215693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.215752:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226641792:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.215796:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.215818:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226642304:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.215839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.215855:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226642816:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.215875:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.215895:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788863903.215901:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226641664:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.215923:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.216058:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226642176:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.216144:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.216169:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226642688:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.216195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.216243:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226641408 00000100:00100000:1.0:1788863903.216251:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226641408 00000100:00100000:1.0:1788863903.216309:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226641920 00000100:00100000:1.0:1788863903.216312:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226641920 00000100:00100000:1.0:1788863903.216330:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788863903.216338:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226641408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.216393:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226641408:12345-0@lo:400:kworker.0 Request processed in 55us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863903.216464:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788863903.216482:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788863903.216489:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226641920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.216520:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226641920:12345-0@lo:400:kworker.0 Request processed in 32us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863903.216526:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788863903.216565:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226641536 00000100:00100000:1.0:1788863903.216569:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226641536 00000100:00100000:1.0:1788863903.216597:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642048 00000100:00100000:1.0:1788863903.216600:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642048 00000100:00100000:1.0:1788863903.216613:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226641664 00000100:00100000:1.0:1788863903.216616:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226641664 00000100:00100000:1.0:1788863903.216627:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642176 00000100:00100000:1.0:1788863903.216630:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642176 00000100:00100000:1.0:1788863903.216661:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863903.216670:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226641536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.216710:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226641536:12345-0@lo:400:kworker.0 Request processed in 42us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863903.216721:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863903.216732:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226641280 00000100:00100000:0.0:1788863903.216739:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226641280 00000100:00100000:1.0:1788863903.216740:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863903.216756:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226642048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863903.216793:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788863903.216799:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226643072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863903.216807:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226642048:12345-0@lo:400:kworker.0 Request processed in 54us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863903.216807:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226641280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.216837:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863903.216855:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863903.216865:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226641664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863903.216890:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863903.216905:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226641280:12345-0@lo:400:kworker.0 Request processed in 101us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863903.216915:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788863903.216922:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226641664:12345-0@lo:400:kworker.0 Request processed in 58us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863903.216930:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863903.216963:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863903.216978:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226642176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863903.216980:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226643072 00000100:00100000:2.0:1788863903.216988:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226643072 00000100:00080000:0.0:1788863903.217021:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863903.217029:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863903.217035:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875759226642176:12345-0@lo:400:kworker.0 Request processed in 61us (888us total) trans 0 rc 0/0 00000100:00080000:0.0:1788863903.217035:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863903.217040:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863903.217047:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863903.217066:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863903.217068:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226641792 00000100:00100000:2.0:1788863903.217071:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226643072:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863903.217104:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226641792 00000100:00100000:0.0:1788863903.217130:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642304 00000100:00100000:0.0:1788863903.217135:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642304 00000100:00100000:0.0:1788863903.217149:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642816 00000100:00100000:0.0:1788863903.217152:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642816 00002000:00000024:2.0:1788863903.217154:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863903.217197:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226641664:0@lo:400:kworker.0 00000100:00100000:0.0:1788863903.217197:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226642688 00000100:00100000:0.0:1788863903.217202:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226642688 00000100:00100000:2.0:1788863903.217222:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226643072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863903.217229:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226642176:0@lo:400:kworker.0 00000100:00100000:0.0:1788863903.217230:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788863903.217255:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863903.217256:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226641792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.217260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226641280:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.217332:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788863903.217341:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226642304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.217398:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226642304:12345-0@lo:400:kworker.0 Request processed in 58us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.217401:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226643072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863903.217415:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788863903.217482:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788863903.217492:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226642816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863903.217537:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226642816:12345-0@lo:400:kworker.0 Request processed in 47us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.217542:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788863903.217559:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788863903.217566:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226642688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863903.217593:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226642688:12345-0@lo:400:kworker.0 Request processed in 28us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.217599:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788863903.217623:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863903.217627:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863903.217772:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226642688:0@lo:400:kworker.0 00000100:00100000:1.0:1788863903.217788:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226642304:0@lo:400:kworker.0 00000100:00100000:0.0:1788863903.217806:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226641792:12345-0@lo:400:kworker.0 Request processed in 558us (2007us total) trans 0 rc 0/0 00010000:00080000:1.0:1788863903.217811:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440d1880 x1875759226642816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863903.217824:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226642816:0@lo:400:kworker.0 00000100:00100000:0.0:1788863903.217834:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788863903.217858:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226641792:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.218667:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226641536:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.218683:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226642048:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.218695:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226641408:0@lo:400:kworker.0 00000100:00100000:3.0:1788863903.218707:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226641920:0@lo:400:kworker.0 00000040:00080000:2.0:1788863903.275374:0:17098:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788863903.275388:0:17098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863903.275423:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788863903.275437:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788863903.275678:0:17098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17098:1875759226643200:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788863903.275815:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863903.288981:0:17098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17098:1875759226643200:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788863903.290835:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863903.291665:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205589888 00000100:00100000:2.0:1788863903.291681:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205589888 00000100:00100000:2.0:1788863903.291792:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:2.0:1788863903.291803:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+37:15681:x1875759205589888:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863903.291844:0:17060:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863903.292200:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+37:15681:x1875759205589888:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 398us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.292211:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00080000:0.0:1788863903.292472:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863903.314068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.314341:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205590016 00000100:00100000:3.0:1788863903.314355:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205590016 00000100:00100000:3.0:1788863903.314439:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:3.0:1788863903.314451:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+37:15681:x1875759205590016:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788863903.314552:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314575:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314614:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314643:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314655:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314662:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314692:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314702:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314709:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863903.314772:0:19853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788863903.314778:0:19853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863903.314794:0:19853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314806:0:19853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314812:0:19853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314830:0:19853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314837:0:19853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.314842:0:19853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314850:0:19853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314863:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e671b75400) 00010000:00010000:3.0:1788863903.314866:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.314872:0:19853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314878:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a61a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314894:0:19853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314900:0:19853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314905:0:19853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314910:0:19853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.314913:0:19853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314928:0:19853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314936:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff89e65d52e400) 00010000:00010000:3.0:1788863903.314938:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.314941:0:19853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314947:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a621 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314963:0:19853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314970:0:19853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314975:0:19853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314980:0:19853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.314983:0:19853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314989:0:19853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.314995:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863903.314998:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.315001:0:19853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.315017:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a628 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.315355:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+37:15681:x1875759205590016:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 Request processed in 903us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.315366:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:3.0:1788863903.320834:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.321338:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205590272 00000100:00100000:0.0:1788863903.321353:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205590272 00000100:00100000:0.0:1788863903.321643:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:0.0:1788863903.321657:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+37:15681:x1875759205590272:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863903.321686:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863903.321713:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a62f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518840d expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.321859:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.321879:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.321894:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863903.321907:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788863903.322018:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322027:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322035:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322103:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ba00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.322109:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322119:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322134:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863903.322137:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863903.322143:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322149:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ba00/0xf569beb9d4b6a636 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322198:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a62f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518840d expref: 39 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322209:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e671b75400) 00010000:00010000:0.0:1788863903.322211:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863903.322215:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a62f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518840d expref: 39 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.322224:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863903.322318:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+38:15681:x1875759205590272:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 665us (1500us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788863903.322327:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:2.0:1788863903.325517:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.325698:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205590400 00000100:00100000:3.0:1788863903.325712:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205590400 00000100:00100000:3.0:1788863903.325787:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:3.0:1788863903.325799:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+38:15681:x1875759205590400:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788863903.325849:0:19853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788863903.326018:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+38:15681:x1875759205590400:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 221us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.326027:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:1.0:1788863903.333054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863903.333329:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205590656 00000100:00100000:2.0:1788863903.333346:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205590656 00000100:00100000:2.0:1788863903.333473:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:2.0:1788863903.333485:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+38:15681:x1875759205590656:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863903.333516:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863903.333546:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd600/0xf569beb9d4b6a644 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188414 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863903.334163:0:17060:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1788863903.334172:0:17060:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788863903.334208:0:17060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788863903.334393:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc600/0xf569beb9d4b6a64b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.334412:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc600/0xf569beb9d4b6a64b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.334437:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc600/0xf569beb9d4b6a64b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.334511:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bd600/0xf569beb9d4b6a644 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188414 expref: 41 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.334532:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc600/0xf569beb9d4b6a64b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188414 expref: 40 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.334542:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e542bf4b00) 00010000:00010000:2.0:1788863903.334545:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863903.334550:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bc600, rc 0) 00000100:00100000:2.0:1788863903.335642:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+40:15681:x1875759205590656:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 1147us (1592us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788863903.335663:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:1.0:1788863903.340472:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.340650:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205590912 00000100:00100000:3.0:1788863903.340664:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205590912 00000100:00100000:3.0:1788863903.340741:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:3.0:1788863903.340754:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+40:15681:x1875759205590912:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863903.340830:0:19853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863903.340864:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc600/0xf569beb9d4b6a64b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188414 expref: 40 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.340887:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e542bf4b00) 00010000:00010000:3.0:1788863903.340899:0:19853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863903.340949:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.340967:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.340978:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341654:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341678:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341691:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341909:0:19853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341917:0:19853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341924:0:19853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341929:0:19853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.341934:0:19853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341942:0:19853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341973:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:3.0:1788863903.341976:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.341981:0:19853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.341987:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a659 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.342001:0:19853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.342008:0:19853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.342013:0:19853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.342018:0:19853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.342021:0:19853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.342026:0:19853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.342034:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe4fbe30e (ffff89e65d52e400) 00010000:00010000:3.0:1788863903.342036:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.342039:0:19853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.342045:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a660 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe4fbe30e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.342259:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+39:15681:x1875759205590912:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 1501us (1795us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863903.342269:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:1.0:1788863903.345822:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.345978:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205591040 00000100:00100000:3.0:1788863903.345988:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205591040 00000100:00100000:3.0:1788863903.346054:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788863903.346064:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+39:15681:x1875759205591040:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863903.346107:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863903.346133:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a667 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518841b expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.346351:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a66e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.346367:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a66e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.346379:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a66e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.346494:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a667 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518841b expref: 41 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.346512:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a66e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518841b expref: 40 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.346521:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:3.0:1788863903.346534:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863903.346538:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922000, rc 0) 00000100:00100000:3.0:1788863903.346691:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+40:15681:x1875759205591040:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 628us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.346699:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:1.0:1788863903.357409:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.370985:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205591296 00000100:00100000:0.0:1788863903.371019:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205591296 00000100:00100000:0.0:1788863903.371119:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:0.0:1788863903.371130:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+40:15681:x1875759205591296:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788863903.371222:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.371241:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.371253:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863903.371434:0:17062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788863903.371445:0:17062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 570495368643ns, next at 571495365990ns, rc = 0 00000004:00010000:0.0:1788863903.371497:0:17062:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4c82543 reply state 000000006bccde7a transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.371510:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.371518:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:0.0:1788863903.371521:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788863903.371525:0:17062:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863903.371800:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+42:15681:x1875759205591296:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 670us (14401us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788863903.371809:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:1.0:1788863903.378197:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863903.378330:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205591424 00000100:00100000:2.0:1788863903.378340:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205591424 00000100:00100000:2.0:1788863903.378402:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:2.0:1788863903.378413:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+42:15681:x1875759205591424:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863903.378436:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863903.378458:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188422 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.378516:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 43 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.378543:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 43 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.378588:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:2.0:1788863903.378592:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863903.378596:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bc000, rc 0) 00000100:00100000:2.0:1788863903.378664:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+43:15681:x1875759205591424:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 253us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.378671:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:2.0:1788863903.386985:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.387147:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205591552 00000100:00100000:0.0:1788863903.387167:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205591552 00000100:00100000:0.0:1788863903.387216:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:0.0:1788863903.387225:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+5:2408:x1875759205591552:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788863903.387500:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+6:2408:x1875759205591552:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 274us (522us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788863903.387508:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:1.0:1788863903.396747:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.396913:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205591808 00000100:00100000:3.0:1788863903.396923:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205591808 00000100:00100000:3.0:1788863903.396979:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788863903.396989:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+43:15681:x1875759205591808:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788863903.397266:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+44:15681:x1875759205591808:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 279us (530us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788863903.397274:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788863903.411778:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.411958:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205592064 00000100:00100000:0.0:1788863903.411968:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205592064 00000100:00100000:0.0:1788863903.412028:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:0.0:1788863903.412038:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+44:15681:x1875759205592064:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863903.412205:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+44:15681:x1875759205592064:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 168us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863903.412213:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:2.0:1788863903.419168:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.419421:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205592192 00000100:00100000:3.0:1788863903.419433:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205592192 00000100:00100000:3.0:1788863903.419489:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:3.0:1788863903.419500:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+44:15681:x1875759205592192:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863903.419530:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863903.419552:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a683 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188429 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.419641:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a68a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.419657:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.419670:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863903.419745:0:17060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788863903.419766:0:17060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.419794:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a683 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188429 expref: 46 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.419810:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a68a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188429 expref: 45 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.419818:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:3.0:1788863903.419821:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788863903.419825:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650922c00, rc 0) 00000100:00100000:3.0:1788863903.419895:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+45:15681:x1875759205592192:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 395us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.419902:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:0.0:1788863903.423589:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863903.423833:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205592320 00000100:00100000:2.0:1788863903.423844:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205592320 00000100:00100000:2.0:1788863903.423905:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788863903.423915:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2472872-203b-4543-b84a-9e24d2c107a6+6:2408:x1875759205592320:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863903.423934:0:18568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863903.423955:0:18568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188430 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863903.423982:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe59f, blocks: 0x0 00010000:00010000:2.0:1788863903.424003:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788863903.424008:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863903.424018:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 7 pid: 18568 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.424036:0:18568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 7 pid: 18568 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.424070:0:18568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bd000, rc 0) 00000100:00100000:2.0:1788863903.424171:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2472872-203b-4543-b84a-9e24d2c107a6+7:2408:x1875759205592320:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 257us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.424178:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788863903.436019:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.442293:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205592576 00000100:00100000:0.0:1788863903.442309:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205592576 00000100:00100000:0.0:1788863903.442442:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788863903.442454:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+45:15681:x1875759205592576:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863903.442653:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+45:15681:x1875759205592576:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 201us (6643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863903.442660:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:3.0:1788863903.459323:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863903.459673:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205592704 00000100:00100000:2.0:1788863903.459684:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205592704 00000100:00100000:2.0:1788863903.459758:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:2.0:1788863903.459769:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+45:15681:x1875759205592704:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788863903.475880:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788863903.475900:0:17040:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788863903.475972:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788863903.476156:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+20:15681:x1875759205592704:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 Request processed in 16383us (16836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.476166:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:1.0:1788863903.476814:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226643328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788863903.476876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863903.476937:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226643328 00000100:00100000:1.0:1788863903.476944:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226643328 00000100:00100000:1.0:1788863903.476988:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863903.476998:0:18570:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226643328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788863903.477171:0:18570:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788863903.477175:0:18570:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788863903.477177:0:18570:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788863903.477179:0:18570:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788863903 -> 1788863903 00002000:00010000:1.0:1788863903.477182:0:18570:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788863903.477220:0:18570:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226643328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (344us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788863903.477227:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788863903.477267:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e543440a80/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788863903.477272:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226643328:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788863903.477920:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.477933:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.477941:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.477947:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.477952:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.477975:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.477992:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:3.0:1788863903.477995:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788863903.478001:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.478007:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6a4a7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480798:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480817:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480825:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480850:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.480855:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480863:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480881:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e66270f000) 00010000:00010000:0.0:1788863903.480884:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863903.480889:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480896:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6a453 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480920:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480926:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480931:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480936:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.480939:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480946:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480964:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:0.0:1788863903.480966:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863903.480970:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480976:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6a45a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480993:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.480999:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481005:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481009:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.481012:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481018:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481024:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89e671b75a00) 00010000:00010000:0.0:1788863903.481027:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863903.481030:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481035:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a400/0xf569beb9d4b6a502 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481717:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481729:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481735:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481740:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bda00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.481744:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481751:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481760:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863903.481763:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863903.481766:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481771:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bda00/0xf569beb9d4b6a587 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481785:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481792:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481798:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481814:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259ae00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.481817:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481823:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481832:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863903.481835:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863903.481837:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481843:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259ae00/0xf569beb9d4b6a5aa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481856:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481862:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481866:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481871:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.481873:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481879:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481897:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863903.481900:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863903.481903:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481908:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99a00/0xf569beb9d4b6a5f0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481920:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481926:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481932:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481937:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.481939:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481944:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481951:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:0.0:1788863903.481953:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788863903.481955:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.481961:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259a200/0xf569beb9d4b6a675 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863903.484270:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863903.484535:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205592832 00000100:00100000:2.0:1788863903.484547:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205592832 00000100:00100000:2.0:1788863903.484613:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:2.0:1788863903.484624:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+7:2409:x1875759205592832:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788863903.484746:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+7:2409:x1875759205592832:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 Request processed in 123us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.484754:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:2.0:1788863903.490935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.491172:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205593088 00000100:00100000:3.0:1788863903.491182:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205593088 00000100:00100000:3.0:1788863903.491288:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788863903.491298:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+14:15681:x1875759205593088:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863903.491353:0:17062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863903.491376:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a68a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188429 expref: 14 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.491396:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:3.0:1788863903.491400:0:17062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863903.491427:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.491441:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.491449:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863903.491590:0:17062:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb836a14 reply state 000000005e0563d3 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.491602:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.491609:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:3.0:1788863903.491611:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788863903.491614:0:17062:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863903.491710:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+15:15681:x1875759205593088:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 414us (785us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788863903.491717:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:2.0:1788863903.498921:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.499028:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205593216 00000100:00100000:0.0:1788863903.499038:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205593216 00000100:00100000:0.0:1788863903.499130:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:0.0:1788863903.499139:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+7:15681:x1875759205593216:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863903.499166:0:19012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863903.499184:0:19012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188437 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.499217:0:19012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 8 pid: 18568 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.499226:0:19012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863903.499230:0:19012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863903.499235:0:19012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 8 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.499270:0:19012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 8 pid: 18568 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.499283:0:19012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 8 pid: 18568 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863903.499299:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19012:1875759226643456:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788863903.499382:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863903.508021:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19012:1875759226643456:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863903.508072:0:19012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 8 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.508124:0:19012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863903.508200:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+8:15681:x1875759205593216:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 9061us (9288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863903.508209:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:3.0:1788863903.517039:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863903.517196:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205593344 00000100:00100000:1.0:1788863903.517207:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205593344 00010000:00010000:1.0:1788863903.517249:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 8 pid: 18568 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863903.517291:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:1.0:1788863903.517301:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+8:2409:x1875759205593344:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863903.517317:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863903.517339:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 8 pid: 18568 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.517367:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 8 pid: 18568 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.517392:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbc9bb9d/0xf569beb9d4b6a691 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188430 expref: 8 pid: 18568 timeout: 670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.517410:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863903.517415:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863903.517421:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 7 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.517430:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 7 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.517469:0:17045:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 7 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863903.517485:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17045:1875759226643584:192.168.204.35@tcp:105: 00000100:00100000:1.0:1788863903.517669:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c148900 going to sleep for 11 seconds 00000100:00100000:2.0:1788863903.522869:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863903.522974:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17045:1875759226643584:192.168.204.35@tcp:105: 00010000:00010000:1.0:1788863903.522997:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863903.523055:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2472872-203b-4543-b84a-9e24d2c107a6+7:2409:x1875759205593344:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 5756us (6026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863903.523130:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:3.0:1788863903.524734:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205593472 00000100:00100000:3.0:1788863903.524746:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205593472 00000100:00100000:3.0:1788863903.524818:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:3.0:1788863903.524829:0:18570:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2472872-203b-4543-b84a-9e24d2c107a6+7:2409:x1875759205593472:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788863903.525002:0:18570:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788863903.525005:0:18570:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788863903 00002000:00010000:3.0:1788863903.525008:0:18570:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788863900 00002000:00010000:3.0:1788863903.525010:0:18570:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788863903 -> 1788863903 00002000:00010000:3.0:1788863903.525012:0:18570:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788863903.525109:0:18570:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2472872-203b-4543-b84a-9e24d2c107a6+8:2409:x1875759205593472:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 281us (2249us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788863903.525116:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:2.0:1788863903.530793:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863903.531372:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205593600 00000100:00100000:1.0:1788863903.531383:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205593600 00000100:00100000:1.0:1788863903.531443:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:1.0:1788863903.531453:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2472872-203b-4543-b84a-9e24d2c107a6+8:2411:x1875759205593600:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788863903.531498:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.531532:0:18568:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 8 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.531542:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863903.531547:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863903.531551:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.531723:0:18568:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 8 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.531738:0:18568:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 8 pid: 19012 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863903.531753:0:18568:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18568:1875759226643712:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788863903.531849:0:18568:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c148900 going to sleep for 11 seconds 00000100:00100000:1.0:1788863903.540192:0:18568:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18568:1875759226643712:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788863903.540236:0:18568:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863903.542622:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.542762:0:17814:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205593728 00000100:00100000:3.0:1788863903.542784:0:17814:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205593728 00010000:00010000:3.0:1788863903.542826:0:17814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 9 pid: 19012 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.542868:0:17814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:3.0:1788863903.542878:0:17814:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2472872-203b-4543-b84a-9e24d2c107a6+9:2408:x1875759205593728:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863903.542893:0:17814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863903.542914:0:17814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 9 pid: 19012 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.542927:0:17814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 9 pid: 19012 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.542949:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a69f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188437 expref: 9 pid: 19012 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.542967:0:17814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863903.542972:0:17814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863903.542977:0:17814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.542988:0:17814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.543022:0:17814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863903.543379:0:18568:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543389:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543412:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543420:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543429:0:18568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543436:0:18568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788863903.543440:0:18568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543448:0:18568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543461:0:18568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.543478:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5209985/0xf569beb9d4b6a6a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863903.547761:0:17814:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2472872-203b-4543-b84a-9e24d2c107a6+8:2408:x1875759205593728:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 4869us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863903.547777:0:17814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:1.0:1788863903.548111:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2472872-203b-4543-b84a-9e24d2c107a6+7:2411:x1875759205593600:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 Request processed in 16657us (17327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863903.548120:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:0.0:1788863903.556169:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.556326:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205593984 00000100:00100000:3.0:1788863903.556350:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205593984 00000100:00100000:3.0:1788863903.556406:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:3.0:1788863903.556416:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+15:15681:x1875759205593984:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788863903.556501:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.556531:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 15 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.556541:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.556575:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 15 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.556588:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 15 pid: 17062 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.556603:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226643840:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788863903.556687:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542802780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863903.566549:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226643840:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788863903.566583:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863903.576434:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.576929:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205594112 00000100:00100000:3.0:1788863903.576939:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205594112 00010000:00010000:3.0:1788863903.576982:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 16 pid: 17062 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.577055:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:3.0:1788863903.577065:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2472872-203b-4543-b84a-9e24d2c107a6+16:2408:x1875759205594112:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863903.577102:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863903.577109:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 16 pid: 17062 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.577121:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 16 pid: 17062 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.577143:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a580 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883d5 expref: 16 pid: 17062 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.577172:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863903.577178:0:17046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 15 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.577189:0:17046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.577197:0:17046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.577204:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.577239:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863903.577354:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2472872-203b-4543-b84a-9e24d2c107a6+15:2408:x1875759205594112:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 291us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.577371:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00010000:00010000:2.0:1788863903.577838:0:17061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.577849:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.578048:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.578071:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 15 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.578105:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.578138:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 15 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.578151:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 15 pid: 17060 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863903.578185:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226643968:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788863903.578247:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863903.589238:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.589379:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226643968:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788863903.589407:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.589492:0:17047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205594240 00000100:00100000:3.0:1788863903.589499:0:17047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205594240 00010000:00010000:3.0:1788863903.589546:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 16 pid: 17060 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.589584:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:3.0:1788863903.589594:0:17047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6586ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2472872-203b-4543-b84a-9e24d2c107a6+16:2409:x1875759205594240:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863903.589609:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863903.589616:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 16 pid: 17060 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.589640:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 16 pid: 17060 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.589661:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bc000/0xf569beb9d4b6a67c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188422 expref: 16 pid: 17060 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.589676:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:3.0:1788863903.589680:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.589690:0:17047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.589698:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.589911:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863903.589970:0:17047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6586ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2472872-203b-4543-b84a-9e24d2c107a6+15:2409:x1875759205594240:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 377us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.589979:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00010000:00010000:0.0:1788863903.590060:0:17061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.590068:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863903.590215:0:17061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788863903.590326:0:17061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788863903.590365:0:17061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788863903.590440:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17061:1875759226644096:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788863903.590483:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863903.590543:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863903.591399:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226644096 00000100:00100000:2.0:1788863903.591407:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226644096 00000100:00100000:2.0:1788863903.591458:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788863903.591474:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17061:x1875759226644096:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788863903.591572:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17061:x1875759226644096:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.591580:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788863903.591898:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17061:1875759226644096:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788863903.592072:0:17061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788863903.592150:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17061:1875759226644224:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788863903.592267:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863903.592285:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788863903.592490:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226644224 00000100:00100000:2.0:1788863903.592496:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226644224 00000100:00100000:2.0:1788863903.592824:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788863903.592834:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17061:x1875759226644224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788863903.592983:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17061:x1875759226644224:12345-0@lo:1000:mdt00_001.0 Request processed in 147us (711us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788863903.592991:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863903.593352:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17061:1875759226644224:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788863903.593392:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.593402:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.593409:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.593415:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bcc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.593420:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.593427:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.593443:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:0.0:1788863903.593446:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863903.593450:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.593456:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bcc00/0xf569beb9d4b6a6b4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.593508:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594374:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594386:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594392:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259aa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.594396:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594404:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594416:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863903.594418:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863903.594426:0:17061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 18 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594438:0:17061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 18 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594448:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 18 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.594534:0:17061:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 18 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863903.594563:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226644352:192.168.204.35@tcp:105: 00000100:00100000:0.0:1788863903.594663:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808efcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863903.601430:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.601536:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875759226644352:192.168.204.35@tcp:105: 00010000:00010000:0.0:1788863903.601569:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601579:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259aa00/0xf569beb9d4b6a60c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601608:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601623:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601645:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601655:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601661:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601666:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601670:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.601674:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601697:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601830:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863903.601834:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863903.601839:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601844:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259b000/0xf569beb9d4b6a6bb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601855:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601860:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601865:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601869:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788863903.601872:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601877:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601884:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:0.0:1788863903.601887:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863903.601889:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.601906:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863903.602067:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+18:15681:x1875759205593984:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 45652us (45919us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788863903.602097:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000020:00080000:0.0:1788863903.602103:0:17061:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788863903.602741:0:17098:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788863903.602746:0:17098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863903.602779:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788863903.602788:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788863903.603017:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205594368 00000100:00100000:3.0:1788863903.603026:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205594368 00000100:00100000:3.0:1788863903.603106:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:3.0:1788863903.603116:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+18:15679:x1875759205594368:12345-192.168.204.35@tcp:49:bash.0 00000100:00100000:3.0:1788863903.603231:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+18:15679:x1875759205594368:12345-192.168.204.35@tcp:49:bash.0 Request processed in 116us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.603237:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1788863903.607332:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.607444:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205594624 00000100:00100000:3.0:1788863903.607454:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205594624 00000100:00100000:2.0:1788863903.607696:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:2.0:1788863903.607707:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+18:15681:x1875759205594624:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788863903.607975:0:17063:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788863903.608023:0:17063:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788863903.608068:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.608111:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.608123:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.608145:0:17063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.608151:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.608169:0:17063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863903.608191:0:17063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788863903.608277:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+20:15681:x1875759205594624:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 572us (955us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788863903.608285:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000020:00080000:2.0:1788863903.608291:0:17063:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788863903.608963:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863903.608971:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.608978:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bce00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788863903.608982:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.608990:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.609005:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:3.0:1788863903.609007:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788863903.609011:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.609031:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e6808bce00/0xf569beb9d4b6a6c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.609044:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863903.609045:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863903.609047:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863903.613357:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.613429:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205594752 00000100:00100000:0.0:1788863903.613439:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205594752 00000100:00100000:0.0:1788863903.613499:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:0.0:1788863903.613510:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+7:15679:x1875759205594752:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788863903.613541:0:19012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863903.613561:0:19012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a6c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518843e expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863903.613588:0:19012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9fe59f, atime: 0x6a9fe59c, ctime: 0x6a9fe59f, blocks: 0x0 00010000:00010000:0.0:1788863903.613612:0:19012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788863903.613616:0:19012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863903.613638:0:19012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518843e expref: 8 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.613657:0:19012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518843e expref: 8 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863903.613669:0:19012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64259a200, rc 0) 00000100:00100000:0.0:1788863903.613738:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+8:15679:x1875759205594752:12345-192.168.204.35@tcp:101:bash.0 Request processed in 230us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863903.613759:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:0.0:1788863903.617454:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.617545:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205594880 00000100:00100000:3.0:1788863903.617556:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205594880 00000100:00100000:3.0:1788863903.617620:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:3.0:1788863903.617641:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+20:15679:x1875759205594880:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1788863903.617668:0:19853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863903.617688:0:19853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188445 expref: -99 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.617728:0:19853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a6d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.617741:0:19853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.617752:0:19853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.617978:0:19853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188445 expref: 22 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.617996:0:19853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188445 expref: 21 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.618017:0:19853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863903.618020:0:19853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863903.618023:0:19853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e650923c00, rc 0) 00000100:00100000:3.0:1788863903.618133:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+21:15679:x1875759205594880:12345-192.168.204.35@tcp:101:bash.0 Request processed in 494us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.618140:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:2.0:1788863903.622638:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863903.622940:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205595136 00000100:00100000:1.0:1788863903.622950:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205595136 00000100:00100000:1.0:1788863903.623005:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:1.0:1788863903.623015:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+21:15679:x1875759205595136:12345-192.168.204.35@tcp:35:bash.0 00000001:00080000:1.0:1788863903.623473:0:17064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:1.0:1788863903.623642:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2472872-203b-4543-b84a-9e24d2c107a6+23:15679:x1875759205595136:12345-192.168.204.35@tcp:35:bash.0 Request processed in 625us (1022us total) trans 8589934632 rc 0/0 00000100:00100000:1.0:1788863903.623650:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000020:00080000:1.0:1788863903.623657:0:17064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788863903.724301:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863903.724327:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226644480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863903.724403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863903.726862:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226644480 00000100:00100000:2.0:1788863903.726877:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226644480 00000100:00100000:2.0:1788863903.726995:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788863903.727006:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226644480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863903.727044:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788863903.727150:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226644480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (2733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863903.727157:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863903.727267:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226644480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863903.870503:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863903.873697:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205595392 00000100:00100000:1.0:1788863903.873787:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205595392 00000100:00100000:1.0:1788863903.873955:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:1.0:1788863903.873967:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+23:15691:x1875759205595392:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788863903.873998:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863903.874021:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030e00/0xf569beb9d4b6a6de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518844c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863903.874141:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788863903.874243:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030e00/0xf569beb9d4b6a6de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518844c expref: 25 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.874272:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:1.0:1788863903.874275:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863903.874280:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e640030e00/0xf569beb9d4b6a6de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518844c expref: 25 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863903.874294:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030e00, rc 0) 00000100:00100000:1.0:1788863903.874368:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+24:15691:x1875759205595392:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 404us (3876us total) trans 8589934633 rc 301/301 00000100:00100000:1.0:1788863903.874375:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:1.0:1788863903.882821:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863903.883112:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205595520 00000100:00100000:3.0:1788863903.883122:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205595520 00000100:00100000:3.0:1788863903.883180:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:3.0:1788863903.883190:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+24:15691:x1875759205595520:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:3.0:1788863903.883267:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883283:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883298:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883313:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883319:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883325:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883420:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883430:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883437:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863903.883484:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883496:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883502:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883509:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883516:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.883520:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883527:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883539:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:3.0:1788863903.883542:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.883547:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883560:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922600/0xf569beb9d4b6a6ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883575:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883581:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883587:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883592:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.883595:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883601:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883610:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89e65d52e400) 00010000:00010000:3.0:1788863903.883612:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.883616:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883630:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922c00/0xf569beb9d4b6a6f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883645:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883650:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883662:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883666:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167dc00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788863903.883669:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883675:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883682:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863903.883685:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863903.883687:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863903.883693:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64167dc00/0xf569beb9d4b6a6fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863903.883781:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2472872-203b-4543-b84a-9e24d2c107a6+24:15691:x1875759205595520:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 590us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863903.883789:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:2.0:1788863903.886302:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863903.886442:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205595776 00000100:00100000:0.0:1788863903.886452:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205595776 00000100:00100000:0.0:1788863903.886515:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:0.0:1788863903.886525:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+24:15691:x1875759205595776:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788863903.886851:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+25:15691:x1875759205595776:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 327us (557us total) trans 8589934634 rc 0/0 00000100:00100000:0.0:1788863903.886860:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00010000:00010000:0.0:1788863904.044944:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863904.747562:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863904.747587:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226644608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863904.747786:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.747940:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226644608 00000100:00100000:2.0:1788863904.747949:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226644608 00000100:00100000:2.0:1788863904.748010:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788863904.748019:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226644608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788863904.748052:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788863904.748127:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226644608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863904.748134:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788863904.748487:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226644736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863904.748518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863904.748568:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226644608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863904.748579:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226644864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863904.748621:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863904.748647:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226644864 00000100:00100000:0.0:1788863904.748651:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226644864 00000100:00100000:0.0:1788863904.748746:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863904.748753:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226644864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863904.748780:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863904.748821:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226644864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863904.748828:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788863904.748929:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226644864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863904.748997:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226644736 00000100:00100000:2.0:1788863904.749002:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226644736 00000100:00100000:2.0:1788863904.749036:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788863904.749044:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875759226644736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863904.749058:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788863904.749119:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875759226644736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863904.749125:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863904.749225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226644736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863905.067510:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863905.647399:0:17098:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788863905.647406:0:17098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863905.647423:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788863905.647430:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:1.0:1788863905.945476:0:20239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788863906.091423:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863906.290984:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863906.291042:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863906.291756:0:18573:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205595904 00000100:00100000:0.0:1788863906.291766:0:18573:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205595904 00002000:00100000:0.0:1788863906.291830:0:18573:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff89e5440eaa00 x1875759205595904/t0(0) o4->f2472872-203b-4543-b84a-9e24d2c107a6@192.168.204.35@tcp:137/0 lens 504/0 e 0 to 0 dl 1788863917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788863906.291842:0:18573:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e5440eaa00 with x1875759205595904 ext(0->8) 00002000:00010000:0.0:1788863906.291847:0:18573:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e5440eaa00 00000100:00100000:0.0:1788863906.291882:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1788863906.291891:0:18573:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2472872-203b-4543-b84a-9e24d2c107a6+8:2409:x1875759205595904:12345-192.168.204.35@tcp:4:bash.0 00000100:00100000:1.0:1788863906.293444:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596032 00000100:00100000:1.0:1788863906.293458:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596032 00000100:00100000:1.0:1788863906.293515:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:1.0:1788863906.293524:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+11:2408:x1875759205596032:12345-192.168.204.35@tcp:16:kworker.0 00000100:00080000:2.0:1788863906.294065:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863906.297409:0:18573:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2472872-203b-4543-b84a-9e24d2c107a6+11:2409:x1875759205595904:12345-192.168.204.35@tcp:4:bash.0 Request processed in 5491us (6337us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788863906.297430:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00002000:00100000:0.0:1788863906.297448:0:18573:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff89e5440eaa00 x1875759205595904/t8589934599(0) o4->f2472872-203b-4543-b84a-9e24d2c107a6@192.168.204.35@tcp:137/0 lens 504/448 e 0 to 0 dl 1788863917 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788863906.297471:0:18573:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89e5440eaa00 with x1875759205595904 ext(0->8) 00002000:00010000:0.0:1788863906.297481:0:18573:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e5440eaa00 00000001:00080000:3.0:1788863906.302631:0:18564:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1788863906.302656:0:18564:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:1.0:1788863906.319654:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+6:2408:x1875759205596032:12345-192.168.204.35@tcp:16:kworker.0 Request processed in 26114us (28662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863906.319670:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00010000:00010000:3.0:1788863907.118379:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863907.330648:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863907.330706:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863907.330744:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863907.330771:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863907.330791:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863907.330812:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863907.330841:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863907.330875:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596416 00000100:00100000:2.0:1788863907.330887:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596416 00000100:00100000:0.0:1788863907.330931:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596160 00000100:00100000:0.0:1788863907.330953:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596160 00000100:00100000:2.0:1788863907.330958:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596288 00000100:00100000:2.0:1788863907.330960:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596288 00000100:00100000:0.0:1788863907.330991:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 171 00000100:00100000:2.0:1788863907.330998:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596928 00000100:00100000:2.0:1788863907.331001:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596928 00000100:00100000:0.0:1788863907.331002:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2410:x1875759205596160:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863907.331014:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596800 00000100:00100000:2.0:1788863907.331016:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596800 00000100:00100000:2.0:1788863907.331029:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:2.0:1788863907.331035:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205596416:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863907.331113:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 81 00000100:00100000:3.0:1788863907.331123:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+25:2410:x1875759205596288:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863907.331132:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205596416:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 97us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863907.331140:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 80 00000100:00100000:2.0:1788863907.331159:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:2.0:1788863907.331165:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205596928:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863907.343947:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2410:x1875759205596160:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 12925us (13292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863907.343966:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 171 00000100:00100000:3.0:1788863907.360431:0:19853:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788863907.361163:0:19853:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788863907.361192:0:17062:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788863907.361216:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:3.0:1788863907.361234:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205596800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863907.361330:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2411:x1875759205596800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 103us (30487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863907.361339:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 83 00000100:00100000:3.0:1788863907.361384:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596544 00000100:00100000:3.0:1788863907.361395:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596544 00000100:00100000:3.0:1788863907.361438:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205596672 00000100:00100000:3.0:1788863907.361441:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205596672 00000100:00100000:3.0:1788863907.361468:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:3.0:1788863907.361474:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+6:2410:x1875759205596544:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863907.361669:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863907.361771:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863907.361869:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205597056 00000100:00100000:1.0:1788863907.361874:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205597056 00000100:00100000:1.0:1788863907.361897:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205597184 00000100:00100000:1.0:1788863907.361899:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205597184 00000100:00100000:1.0:1788863907.361916:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:1.0:1788863907.361922:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2407:x1875759205596672:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:1.0:1788863907.361948:0:18569:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a357 00000100:00080000:1.0:1788863907.361968:0:18569:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788863907.362037:0:18569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788863907.364300:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2472872-203b-4543-b84a-9e24d2c107a6+2:2407:x1875759205596672:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 2357us (33487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.364319:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:1.0:1788863907.364370:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:1.0:1788863907.364389:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2407:x1875759205597056:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:1.0:1788863907.364425:0:18569:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a38f 00000100:00080000:1.0:1788863907.364443:0:18569:0:(import.c:65:import_set_state_nolock()) ffff89e543ac6800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788863907.364788:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+6:2410:x1875759205596544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (30731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863907.364803:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:3.0:1788863907.364822:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:3.0:1788863907.364831:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2407:x1875759205597184:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:3.0:1788863907.364856:0:19012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a396 00000100:00080000:3.0:1788863907.364864:0:19012:0:(import.c:65:import_set_state_nolock()) ffff89e543ac5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863907.364927:0:19012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:1.0:1788863907.367161:0:18569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788863907.367443:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+2:2407:x1875759205597056:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 3055us (5765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.367459:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:3.0:1788863907.368995:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+2:2407:x1875759205597184:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 4153us (7213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863907.369010:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00080000:2.0:1788863907.369129:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863907.369137:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863907.369141:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863907.369144:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788863907.369319:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863907.369429:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+25:2410:x1875759205596288:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 38305us (38680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.369440:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 81 00010000:00010000:1.0:1788863907.371251:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863907.374256:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2411:x1875759205596928:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 43072us (43423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.374292:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 82 Debug log: 43660 lines, 43660 kept, 0 dropped, 0 bad.